lighthouse bot succeeds even when minimum required threshold is not met

[RVledder]

See the output table on: RVledder/spindle.wtf#7 (comment)

The settings in Travis are set like this: https://github.com/StudioSpindle/spindle.wtf/blob/develop/.travis.yml

Is this a bug or is it a setting that is wrong?

[erezrokah]

@StudioSpindle I had a similar issue. I found out it takes some time until the lighthousebot account responds to the invitation to collaborate.

You can check this here:

[EoinTraynor]

Until Lighthouse accepts the invitation to collaborate it does not have permission to fail a check.
However, it will post a comment on your PR.
Here is the original issue Issue 8

@erezrokah How long did you have to wait for acceptance? I requested collaboration 6 days ago.

[erezrokah]

@EoinTraynor I don't remember exactly. I think a couple of hours