-
Notifications
You must be signed in to change notification settings - Fork 23
Improve build times by moving various things related to correctness from Strata to StrataTest #349
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve build times by moving various things related to correctness from Strata to StrataTest #349
Conversation
*Correct.lean files to StrataTest*Correct.lean files and tests from Strata to StrataTest folder
*Correct.lean files and tests from Strata to StrataTest folder
aqjune-aws
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
If we are to move the Correct files, I think they must not be placed in "StrataTest" because they are not tests. :) Instead we must place them at a new "StrataProof" project.
Re. eval + guard_msgs - did removing them significantly improve the lake build speed? I thought they were supposed to be lightweight.
Not much. It went from about ~120s to ~112s |
Could there be cases where adding a proof makes certain tests no longer necessary? If the answer is yes, wouldn't it make sense to keep the proofs and the tests physically close together, so such cases are more easily identified? Are there cases where you want to verify all the proofs but not run all the tests? What are benefits of keeping the two separate? |
I think tests can still be useful after proofs - when someone wants to make changes to the implementation existing tests are good sanity checks for confirming whether the changes make sense. Confirming it by rewriting proofs will take slightly more. I guess a real concern is that actually there aren't that many proofs at the moment, so the necessity of having a separate StrataProof target seems slightly faint. But on the other hand, the experimental result do show that it is the proofs rather than the |
Do you want me to change something still? I don't have a strong opinion on the folders, so I'm happy to do whatever you prefer. My preference right now is to have both proofs and tests in StrataTest. What I like about the name |
|
Yep, I am fine with putting the proofs in StrataTest since I could not figure out how to add a custom command, e.g., |
|
I would also prefer in the long run a separate |
Partial fix for #349
Changes
#guardor#guard_msgfrom Strata/ to StrataTest/Before:
After:
Testing
Refactoring that does not need any tests