Skip to content

Commit

Permalink
docs: update readme (#187)
Browse files Browse the repository at this point in the history
  • Loading branch information
daejunpark authored Aug 22, 2023
1 parent 38904d8 commit 6be83f7
Show file tree
Hide file tree
Showing 4 changed files with 113 additions and 79 deletions.
60 changes: 60 additions & 0 deletions CONTRIBUTING.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,60 @@
# Contributing to Halmos

We greatly appreciate your feedback, suggestions, and contributions to make Halmos a better tool for everyone!

Join the [Halmos Telegram Group][chat] for any inquiries or further discussions.

[chat]: <https://t.me/+4UhzHduai3MzZmUx>

## Development Setup

If you want to submit a pull request, fork the repository:

```sh
gh repo fork a16z/halmos
```

Or, if you just want to develop locally, clone it:

```sh
git clone [email protected]:a16z/halmos.git
```

Create and activate a virtual environment:

```sh
python3.11 -m venv .venv
source .venv/bin/activate
```

Install the dependencies:

```sh
python -m pip install -r requirements.txt
python -m pip install -r requirements-dev.txt
```

Install and run the git hook scripts:

```sh
pre-commit install
pre-commit run --all-files
```

## Coding Style

We recommend enabling the [black] formatter in your editor, but you can run it manually if needed:

```sh
python -m black .
```

[black]: <https://black.readthedocs.io/en/stable/>

## License

By contributing, you agree that your contributions will be licensed under its [AGPL-3.0](LICENSE) License.

## Disclaimer

_These smart contracts and code are being provided as is. No guarantee, representation or warranty is being made, express or implied, as to the safety or correctness of the user interface or the smart contracts and code. They have not been audited and as such there can be no assurance they will work as intended, and users may experience delays, failures, errors, omissions or loss of transmitted information. THE SMART CONTRACTS AND CODE CONTAINED HEREIN ARE FURNISHED AS IS, WHERE IS, WITH ALL FAULTS AND WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING ANY WARRANTY OF MERCHANTABILITY, NON-INFRINGEMENT OR FITNESS FOR ANY PARTICULAR PURPOSE. Further, use of any of these smart contracts and code may be restricted or prohibited under applicable law, including securities laws, and it is therefore strongly advised for you to contact a reputable attorney in any jurisdiction where these smart contracts and code may be accessible for any questions or concerns with respect thereto. Further, no information provided in this repo should be construed as investment advice or legal advice for any particular facts or circumstances, and is not meant to replace competent counsel. a16z is not liable for any use of the foregoing, and users should proceed with caution and use at their own risk. See a16z.com/disclosures for more info._
89 changes: 11 additions & 78 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -3,15 +3,9 @@
[![License](https://img.shields.io/github/license/a16z/halmos)](https://github.com/a16z/halmos/blob/main/LICENSE)
[![chat](https://img.shields.io/badge/chat-telegram-blue)](https://t.me/+4UhzHduai3MzZmUx)

_Symbolic Bounded Model Checker for Ethereum Smart Contracts Bytecode_
Halmos is a _symbolic testing_ tool for EVM smart contracts. A Solidity/Foundry frontend is currently offered by default, with plans to provide support for other languages, such as Vyper and Huff, in the future.

**_Symbolic_:** Halmos executes the given contract bytecode with symbolic function arguments and symbolic storage states, enabling it to systematically explore all possible behaviors of the contract.

**_Bounded_:** Halmos unrolls loops up to a specified bound and sets the size of variable-length arrays, allowing it to run automatically without the need for additional user annotations.

**_Model Checking_:** Halmos proves that assertions are never violated by any inputs or provides a counter-example. This allows Halmos to be used for bug detection as well as formal verification of the contract.

For more information, refer to our post on "_[Symbolic testing with Halmos: Leveraging existing tests for formal verification][post]_."
You can read more in our post: "_[Symbolic testing with Halmos: Leveraging existing tests for formal verification][post]_."

Join the [Halmos Telegram Group][chat] for any inquiries or further discussions.

Expand All @@ -21,94 +15,33 @@ Join the [Halmos Telegram Group][chat] for any inquiries or further discussions.
## Installation

```
$ pip install halmos
pip install halmos
```

Or, if you want to try the latest dev version:
Or, if you want to try out the nightly build version:
```
$ pip install git+https://github.com/a16z/halmos
pip install git+https://github.com/a16z/halmos
```

## Usage

```
$ cd /path/to/src
$ halmos
cd /path/to/src
halmos
```

For more details:
```
$ halmos --help
halmos --help
```

## Examples

Given a contract, [Example.sol](examples/toy/src/Example.sol):
```solidity
contract Example {
function totalPriceBuggy(uint96 price, uint32 quantity) public pure returns (uint128) {
unchecked {
return uint120(price) * quantity; // buggy type casting: uint120 vs uint128
}
}
}
```

You write some **property-based tests** (in Solidity), [Example.t.sol](examples/toy/test/Example.t.sol):
```solidity
contract ExampleTest is Example {
function testTotalPriceBuggy(uint96 price, uint32 quantity) public pure {
uint128 total = totalPriceBuggy(price, quantity);
assert(quantity == 0 || total >= price);
}
}
```

Then you can run **fuzz testing** to quickly check those properties for **some random inputs**:
```
$ forge test
[PASS] testTotalPriceBuggy(uint96,uint32) (runs: 256, μ: 462, ~: 466)
```

Once it passes, you can also perform **symbolic testing** to verify the same properties for **all possible inputs** (up to a specified limit):
```
$ halmos --function test
[FAIL] testTotalPriceBuggy(uint96,uint32) (paths: 6, time: 0.10s, bounds: [])
Counterexample: [p_price_uint96 = 39614081294025656978550816768, p_quantity_uint32 = 1073741824]
```

_(In this specific example, Halmos discovered an input that violated the assertion, which was missed by the fuzzer!)_

## Develop

```sh
# if you want to submit a pull request, fork the repository:

gh repo fork a16z/halmos

# or if you just want to develop locally, clone it
# git clone [email protected]:a16z/halmos.git

# create and activate a virtual environment
Refer to the [getting started guide](docs/getting-started.md) and the [examples](examples/README.md) directory.

python3.11 -m venv .venv
source .venv/bin/activate
## Contributing

# install the dependencies

python -m pip install -r requirements.txt
python -m pip install -r requirements-dev.txt

# install and run the git hook scripts

pre-commit install
pre-commit run --all-files

# we recommend enabling the black formatter in your editor
# but you can run it manually if needed:

python -m black .
```
Refer to the [contributing guidelines](CONTRIBUTING.md).

## Disclaimer

Expand Down
2 changes: 1 addition & 1 deletion examples/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

#### Usage Examples

- [Simple examples](toy/)
- [Simple examples](toy/README.md)
- [ERC20](tokens/ERC20/): verifying OpenZeppelin and Solmate ERC20 tokens, and finding the DEI token bug exploited by the [Deus DAO hack](https://rekt.news/deus-dao-r3kt/).
- [ERC721](tokens/ERC721/): verifying OpenZeppelin and Solmate ERC721 tokens.

Expand Down
41 changes: 41 additions & 0 deletions examples/toy/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,41 @@
# Simple Examples

Given a contract, [Example.sol](src/Example.sol):
```solidity
contract Example {
function totalPriceBuggy(uint96 price, uint32 quantity) public pure returns (uint128) {
unchecked {
return uint120(price) * quantity; // buggy type casting: uint120 vs uint128
}
}
}
```

You write some **property-based tests** (in Solidity), [Example.t.sol](test/Example.t.sol):
```solidity
contract ExampleTest is Example {
function testTotalPriceBuggy(uint96 price, uint32 quantity) public pure {
uint128 total = totalPriceBuggy(price, quantity);
assert(quantity == 0 || total >= price);
}
}
```

Then you can run **fuzz testing** to quickly check those properties for **some random inputs**:
```
$ forge test
[PASS] testTotalPriceBuggy(uint96,uint32) (runs: 256, μ: 462, ~: 466)
```

Once it passes, you can also perform **symbolic testing** to verify the same properties for **all possible inputs** (up to a specified limit):
```
$ halmos --function test
[FAIL] testTotalPriceBuggy(uint96,uint32) (paths: 6, time: 0.10s, bounds: [])
Counterexample: [p_price_uint96 = 39614081294025656978550816768, p_quantity_uint32 = 1073741824]
```

_(In this specific example, Halmos discovered an input that violated the assertion, which was missed by the fuzzer!)_

## Disclaimer

_These smart contracts and code are being provided as is. No guarantee, representation or warranty is being made, express or implied, as to the safety or correctness of the user interface or the smart contracts and code. They have not been audited and as such there can be no assurance they will work as intended, and users may experience delays, failures, errors, omissions or loss of transmitted information. THE SMART CONTRACTS AND CODE CONTAINED HEREIN ARE FURNISHED AS IS, WHERE IS, WITH ALL FAULTS AND WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING ANY WARRANTY OF MERCHANTABILITY, NON-INFRINGEMENT OR FITNESS FOR ANY PARTICULAR PURPOSE. Further, use of any of these smart contracts and code may be restricted or prohibited under applicable law, including securities laws, and it is therefore strongly advised for you to contact a reputable attorney in any jurisdiction where these smart contracts and code may be accessible for any questions or concerns with respect thereto. Further, no information provided in this repo should be construed as investment advice or legal advice for any particular facts or circumstances, and is not meant to replace competent counsel. a16z is not liable for any use of the foregoing, and users should proceed with caution and use at their own risk. See a16z.com/disclosures for more info._

0 comments on commit 6be83f7

Please sign in to comment.