Software histories & tasks
Complete codebases with their full Git history, plus coding tasks with tests that grade the result.
- 6,000+codebases
- 1.4 millioncommits
Sample
One repository, names removed- c99b8051Add wallet setup script with retry logic and deployment ID generation
- ace112faAdd retry logic and error handling to full-deploy script
- 876cc1fdAdd comprehensive README for SettlementEngine Smart Contracts
- 8a1bcb20Add project guidelines and reorganize contracts with restricted admin
- 8c7c2e29Update README for v2.3 API changes and gasless signatures
- b15153cfAdd script to generate and fund test wallets for SettlementEngine
- 9739cf7dUpdate README v2.2: simplify seller signature, add gasless transfer
- 130a558aAdd internal balance transfer and gasless support
- 5673843bAdd internal balance transfer with gasless support
- 852592efUpdate README to reflect major refactor and new terminology
- ed9069e5Switch SettlementEngine from auction to bet logic
- 94e5e98cAdd scripts to distribute TESTUSD and fund test wallets
- b2ff4a65Add misc/ to .gitignore to exclude miscellaneous files
- 5f83d5adUpdate README with comprehensive documentation and new architecture diagram
- 3ae590c0Update MockERC20 deployment name to reflect SettlementEngine
- d0102f34Add testnet addresses to README and create setup script
- 51ea1a6aAdd RESOLVE prefix to resolution hash
- 30623902Add comprehensive admin authorization tests
- dddbc666Refactor SettlementEngine to use internal balances and token approvals
- 6bd579beAdd auction-based secondary trading to SettlementEngine
Replaces listings with auctions for reselling positions: a seller opens an auction, buyers bid and the seller accepts one. The auction code lives in a new contract, SettlementEngineAuction, which SettlementEngine now builds on instead of the listing contract.
- Commit
- 6bd579be
- Time
- 11 Jan 2026, 19:26 PST
- Files changed
- 26
- Added, deleted, modified
- 5, 7, 14
- Patch lines
- 3,662
26 files changed
contracts/ · 6
- ~SettlementEngine.sol
- +SettlementEngineAuction.sol
- ~SettlementEngineError.sol
- ~SettlementEngineEvent.sol
- −SettlementEngineListing.sol
- ~SettlementEngineStorage.sol
test/ · 20
- +auction/accept-bid.test.js
- +auction/close-auction.test.js
- +auction/open-auction.test.js
- +auction/register-bid.test.js
- ~edge/authorization.test.js
- ~edge/multi-transfer.test.js
- ~edge/position-transfer.test.js
- ~edge/reentrancy.test.js
- ~edge/state-transition.test.js
- ~edge/timestamp.test.js
- ~edge/zero-value.test.js
- −fuzz/listing-price.test.js
- ~fuzz/state-machine.test.js
- ~helper.js
- −listing/buy-position.test.js
- −listing/cancel-listing.test.js
- −listing/edge-case.test.js
- −listing/list-position.test.js
- −listing/secondary-sale-resolution.test.js
- ~token/token-compatibility.test.js
contracts/SettlementEngine.solFirst hunk of commit 4@@ -2,14 +2,14 @@22 pragma solidity ^0.8.24;33 44 import "./SettlementEngineQuote.sol";5-import "./SettlementEngineListing.sol";5+import "./SettlementEngineAuction.sol";66 77 /**88 * @title SettlementEngine9- * @notice Prediction market escrow and secondary trading10- * @dev Inherits quote and listing logic, deploys as single contract9+ * @notice Prediction market escrow and secondary trading via auctions10+ * @dev Inherits quote and auction logic, deploys as single contract1111 */12-contract SettlementEngine is SettlementEngineQuote, SettlementEngineListing {12+contract SettlementEngine is SettlementEngineQuote, SettlementEngineAuction {
- f80f62c7Add Business Source License 1.1 to repository
- 08f1dbddAdd admin controls, protocol fee, and updated env example
- 03c46aabAdd example env, gitignore, and README
Specifications
4 parts| Availability | Existing code and task catalogue, plus tailored programs |
|---|---|
| Formats | Git bundle, Docker + JSONL, Patch + YAML, Playwright |
| Built for | Code pretraining, post-training & agent evaluation |
| Used for | Code pretraining, Supervised post-training, Reinforcement learning, Distillation and evaluation |
Available now
| Repository history | Over 6,000 codebases, about 1.4 million commits |
|---|---|
| Spec-to-repo | 9,600 tasks |
| Long-horizon build and repair | 96,000 repository tasks |
| Security | 16,000 exploit-and-patch tasks |
| Whole applications | 12,800 browser-graded web tasks, 9,600 app specs |
What ships
Full-history software collections
Cloneable repositories with source, tests, configuration, documentation, branches, merges, and the changes that connect them.
Reward-bearing task environments
Runnable starting states, natural-language objectives, tool access, expected outputs, and deterministic setup for policy rollouts.
Executable graders
Held-out assertions, regression suites, exploit-and-patch checkers, and browser workflows that evaluate the resulting behavior.
Verified agent trajectories
Tool-call traces and finished changes graded by the same environment, ready for rejection sampling, distillation, and process analysis.
Quality
Method noteThe Plagiarist Gate: Proving a Benchmark Cannot Be Passed by Recall
A coding task is useless if a model can pass it by remembering the original code. Before a task is used for training or testing, the plagiarist gate installs the public package as is and requires it to fail.
Request a sample
We send real records in the format you would receive, with the field list and where each record came from. Access for evaluation is limited and covered by a mutual NDA.
ProductSoftware histories & tasks