Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce --timeout in quint verify #1196

Closed
konnov opened this issue Sep 29, 2023 · 4 comments
Closed

Introduce --timeout in quint verify #1196

konnov opened this issue Sep 29, 2023 · 4 comments
Assignees
Labels
blocked Blocked by another issue or requirement tla+ transpilation Quint to TLA+ transpiler

Comments

@konnov
Copy link
Contributor

konnov commented Sep 29, 2023

As a follow-up to #1185, it would be great to have a timeout option for every individual symbolic run when quint verify is executed with --random-transitions. In my experiments, it happens that Apalache gets stuck on one of the randomly sequences. It would be great, if it could simply timeout after e.g. 10 min and try another choice of transitions. This should be doable by setting a z3 timeout in Apalache.

This would require changes both in Quint and Apalache.

@konnov konnov added the tla+ transpilation Quint to TLA+ transpiler label Sep 29, 2023
@shonfeder
Copy link
Contributor

On the apalache side, would it suffice to set search.smt.timeout or do we need to set something else?

As an aside: We have the option of making it easier to pass in any apalache configurations without having to add flags for them. So IMO we should be careful how many flags we add that just require mapping into the existing apalache config system, since it amounts to added complexity in our interface and CLI that doesn't translate into any increase in expressiveness or capability in the underlying system. This is mostly accidental complexity and makes the coupling between quint and apalache tighter, increasing the risk of breakage from integration mismatches.

@thpani thpani self-assigned this Oct 4, 2023
@thpani
Copy link
Contributor

thpani commented Oct 10, 2023

Note to self: the right syntax for --apalache-config is:

{
  "checker": {
    "tuning": {
      "search.smt.timeout": 2
    }
  }
}

@thpani
Copy link
Contributor

thpani commented Oct 10, 2023

Blocked by apalache-mc/apalache#2316

Apalache currently quits the search (globally) if it runs into an SMT timeout

@thpani
Copy link
Contributor

thpani commented Nov 13, 2023

Addressed through apalache-mc/apalache#2758

@thpani thpani closed this as completed Nov 13, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
blocked Blocked by another issue or requirement tla+ transpilation Quint to TLA+ transpiler
Projects
None yet
Development

No branches or pull requests

3 participants