Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(windows): don't send key twice #280

Merged
merged 3 commits into from
Sep 1, 2023
Merged

fix(windows): don't send key twice #280

merged 3 commits into from
Sep 1, 2023

Conversation

sigmaSd
Copy link
Collaborator

@sigmaSd sigmaSd commented Aug 30, 2023

see crossterm-rs/crossterm#797 (comment)

windows release event needs to be explicitly ignored

I don't have windows to test , but I saw this issue filed against crossterm many times , so I'm assuming bandwhich have the same problem

crossterm-rs/crossterm#778 would improve things

note: I don't think this will affect tests, maybe we should start disabling the flaky ones

@sigmaSd
Copy link
Collaborator Author

sigmaSd commented Aug 30, 2023

windows ci fails with

Run Invoke-WebRequest -Uri "$env:NPCAP_OEM_URL" -OutFile "$env:TEMP/npcap-oem.exe"
Invoke-WebRequest: D:\a\_temp\0adafdb5-37c4-4718-b5ce-7b33119eb186.ps1:2
Line |
   2 |  Invoke-WebRequest -Uri "$env:NPCAP_OEM_URL" -OutFile "$env:TEMP/npcap …
     |  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
     | Invalid URI: The hostname could not be parsed.

Error: Process completed with exit code 1.

Can prs not access the url variable ?

@cyqsimon
Copy link
Collaborator

cyqsimon commented Aug 30, 2023

Hmm. It seems like it's a permission thingy relating to (dis)allowing secrets access on PRs from external repositories. See https://securitylab.github.com/research/github-actions-preventing-pwn-requests/.

It is possible to allow PRs access to secrets by changing the workflow trigger to pull_request_target. However that introduces the possibility of an attacker exfiltrating secrets with a malicious PR.

Granted PRs from first-time contributors require explicit approval to run workflows, but there's nothing preventing a more cunning attacker from bypassing this by submitting an innocuous PR before the actual attack.

We can change it so that all workflow needs approval, but obviously that's hardly an ideal solution. You got any ideas?

@cyqsimon
Copy link
Collaborator

cyqsimon commented Aug 30, 2023

It can be argued that since the only use for secrets in this repository is npcap's OEM installer download link, the consequences of a pwn is not as significant as that of, let's say, a private key. Considering the consequences for the attacker (likely losing their account), it is unlikely that anyone would find this a worthy target.

Obviously this is a questionable attitude towards security in general. Plus, doing this would mean that we will no longer be able to use Github secrets for something more sensitive if such a need ever arises (e.g. a deploy key). So I don't like this option either.

@sigmaSd
Copy link
Collaborator Author

sigmaSd commented Aug 30, 2023

I didn't find any info about this, but this pr seems to use windows-2019-npcap os in the runner https://github.com/OpenCyphal/yukon/pull/400/files#diff-c34469acb6dfef04f199d518e466db578ba43f7be784fd981d08ae69457ffdcdR14

@sigmaSd
Copy link
Collaborator Author

sigmaSd commented Aug 30, 2023

I see its a self hosted runner.

@cyqsimon
Copy link
Collaborator

For reference, this is how rust-pcap dealt with this:

https://github.com/rust-pcap/pcap/blob/8e3c8ba23f5ec94bf90b8fef98c4239fd9a9a86b/.github/workflows/ci-steps.yml#L57-L62

Not great, not terrible™️. If we cannot come up with something better, I suppose this is what we have to go for.

@cyqsimon
Copy link
Collaborator

@sigmaSd
Copy link
Collaborator Author

sigmaSd commented Aug 30, 2023

I think thats reasonable, but in theory the situation can be better, since many (if not all) the tests don't actually use npcap

Maybe we can have some cfgs to not build it and stub its function when targetting tests

@sigmaSd
Copy link
Collaborator Author

sigmaSd commented Aug 30, 2023

Also for the record, the issue addressed by this PR seems to impact MacOS too, but only occasionally so.

This PR doesn't address the test flakiness issue

This PR adress a problem that occurs on windows, if you press a key it triggers twice because release event gets sent,

I don't have windows to test so it would be great if you actually test that this is indeed a problem and this pr fixes it

I'm just sending this pr without even triggering the bug first because I saw this issue filed many times against crossterm repo

@cyqsimon
Copy link
Collaborator

Maybe we can have some cfgs to not build it and stub its function when targetting tests

Hmm. Good idea. I'll give it a shot in a separate PR.

@cyqsimon
Copy link
Collaborator

Also for the record, the issue addressed by this PR seems to impact MacOS too, but only occasionally so.

This PR doesn't address the test flakiness issue

This PR adress a problem that occurs on windows, if you press a key it triggers twice because release event gets sent,

I don't have windows to test so it would be great if you actually test that this is indeed a problem and this pr fixes it

I'm just sending this pr without even triggering the bug first because I saw this issue filed many times against crossterm repo

I see. Sorry about that. So what do you think about these strange transient failures on MacOS?

@sigmaSd
Copy link
Collaborator Author

sigmaSd commented Aug 30, 2023

Unfortunately I don't have an explanation now

My idea is if we can't actual fix it

  • find which tests are flaky (hopefully its a small subset and hopefully its not all of them xD)
  • disable them or add something like #[flaky] which will run the test for maybe 3 times before saying it failed

@sigmaSd
Copy link
Collaborator Author

sigmaSd commented Aug 30, 2023

Or maybe switch to next-test which does support this https://nexte.st/book/retries.html?highlight=flaky#retries-and-flaky-tests

@cyqsimon
Copy link
Collaborator

I think thats reasonable, but in theory the situation can be better, since many (if not all) the tests don't actually use npcap

Maybe we can have some cfgs to not build it and stub its function when targetting tests

So I tried your idea, but as a wise man once said, trying is the first step towards failure. You tried your best and failed miserably. The lesson is, never try.

Jokes aside, it seems like the entire test binary will fail if stuff from pnet is imported anywhere, which makes gating some tests behind a feature flag much more difficult than I thought it was going to be. Plus, I don't think there actually are many tests (if any at all) not relating to packet capture.

Anyways, my conclusion is that it's way too much effort for too little gain. I'll just disable Windows tests for PRs and call it a day.

@cyqsimon
Copy link
Collaborator

Okay, if you rebase now I think the tests should pass.

* Cache npcap SDK on Windows

* Call build function correctly

* Log when local cache of SDK is found

* Fix clippy warnings

* Log to STDERR
@sigmaSd
Copy link
Collaborator Author

sigmaSd commented Aug 31, 2023

I tried to debug the flaky tests today , but that went nowhere, hopefully you find better ideas

@cyqsimon cyqsimon merged commit ead54b6 into imsnif:main Sep 1, 2023
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants