Skip to content

test: remove duplicate, dead and private-state SDK tests - #2048

Open
devin-ai-integration[bot] wants to merge 15 commits into
mainfrom
devin/1793224550-remove-irrelevant-sdk-tests
Open

devin-ai-integration[bot] wants to merge 15 commits into
mainfrom
devin/1793224550-remove-irrelevant-sdk-tests

Conversation

@devin-ai-integration

@devin-ai-integration devin-ai-integration Bot commented Oct 28, 2026 •

Copy link
Copy Markdown
Contributor

Summary

Removes SDK tests that can't catch a regression the rest of the suite wouldn't already catch. This is the high/medium-confidence delete/merge part of a TDD-style audit of all JS and Python SDK tests (321 files). Rewrites of implementation-coupled tests are in #2049; the gated git suites are removed separately in their own PR. Test-only: no src/ change and no changeset.

What's removed:

  • Copy-pasted tests: JS api/list.test.ts had its whole live-sandbox suite twice, and files/write.test.ts defined 'write file' twice. Also duplicate pty sendInput tests in JS/sync/async, and duplicate volume tests.
  • Deprecated secure option: it's ignored (envd access is always secured), so the test_secure.py / secure.test.ts / *_with_secured_envd tests just repeated the default-sandbox tests. One of them had no assertion.
  • Private-state / tautological tests: test_sync_client_lifecycle.py only asserted private attributes. The private _create_sandbox idempotency tests duplicated the public-API ones. Some transport/retry tests asserted class internals or test helpers (e.g. cleanupBaseDir, test_wait_for_status_retries_transport_errors).
  • Permanently skipped: volume list with depth (JS, sync, async).
  • Merged: sync/async Secret.fill tests now live in tests/shared/secret/test_fill.py. The async from_dockerfile/to_dockerfile tests were copies of tests/shared/template/methods/*, so they're removed.

Every deletion was checked against the remaining suite for any unique behavior it covered. Findings that turned out to be real SDK bugs were left alone (see the rewrite PR).

Verification

  • pnpm run format, pnpm run lint, pnpm run typecheck pass.
  • Python: 934 passed, 1 skipped in touched files.
  • JS touched files: all pass except live tests/api/list.test.ts (empty running/metadata listings), which fails the same way on main (3b0f0fedd).

Linear: SDK-410

Link to Devin session: https://app.devin.ai/sessions/98def51a61574e17908881f74f2f7ded
Open in Devin Desktop: https://app.devin.ai/desktop/session/98def51a61574e17908881f74f2f7ded?variant=devin
Requested by: @mishushakov


🟢 Devin Review found nothing to fix · View findings

Devin Review

@devin-ai-integration

Copy link
Copy Markdown
Contributor Author

I'll fix CI failures and address comments from users with write access. I'll skip comments containing "(aside)".

  • Disable automatic comment, CI, and merge conflict monitoring

@cla-bot cla-bot Bot added the cla-signed label Oct 28, 2026
@changeset-bot

changeset-bot Bot commented Oct 28, 2026 •

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: 96a4761

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@linear-code

linear-code Bot commented Oct 28, 2026

Copy link
Copy Markdown

SDK-410

devin-ai-integration[bot]

This comment was marked as resolved.

@github-actions

github-actions Bot commented Oct 28, 2026 •

Copy link
Copy Markdown
Contributor

Package Artifacts

Built from 9920b32. Download artifacts from this workflow run.

JS SDK (e2b@2.64.1-devin-1793224550-remove-irrelevant-sdk-tests.0, with @e2b/dockerfile-utils@0.1.3-devin-1793224550-remove-irrelevant-sdk-tests.0):

npm install ./e2b-dockerfile-utils-0.1.3-devin-1793224550-remove-irrelevant-sdk-tests.0.tgz ./e2b-2.64.1-devin-1793224550-remove-irrelevant-sdk-tests.0.tgz

CLI (@e2b/cli@2.24.1-devin-1793224550-remove-irrelevant-sdk-tests.0):

npm install ./e2b-cli-2.24.1-devin-1793224550-remove-irrelevant-sdk-tests.0.tgz

Code Interpreter JS SDK (@e2b/code-interpreter@2.9.2-devin-1793224550-remove-irrelevant-sdk-tests.0):

npm install ./e2b-code-interpreter-2.9.2-devin-1793224550-remove-irrelevant-sdk-tests.0.tgz

Desktop JS SDK (@e2b/desktop@2.5.1-devin-1793224550-remove-irrelevant-sdk-tests.0):

npm install ./e2b-desktop-2.5.1-devin-1793224550-remove-irrelevant-sdk-tests.0.tgz

Python SDK (e2b==2.64.0+devin.1793224550.remove.irrelevant.sdk.tests, with e2b-dockerfile-utils==0.1.2+devin.1793224550.remove.irrelevant.sdk.tests):

pip install ./e2b_dockerfile_utils-0.1.2+devin.1793224550.remove.irrelevant.sdk.tests-py3-none-any.whl ./e2b-2.64.0+devin.1793224550.remove.irrelevant.sdk.tests-py3-none-any.whl

Code Interpreter Python SDK (e2b-code-interpreter==2.11.10+devin.1793224550.remove.irrelevant.sdk.tests):

pip install ./e2b_code_interpreter-2.11.10+devin.1793224550.remove.irrelevant.sdk.tests-py3-none-any.whl

Desktop Python SDK (e2b-desktop==2.7.2+devin.1793224550.remove.irrelevant.sdk.tests):

pip install ./e2b_desktop-2.7.2+devin.1793224550.remove.irrelevant.sdk.tests-py3-none-any.whl

@claude claude Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

⚠️ Code review skipped — your organization has no extra usage available to pay for this review.

If your organization's extra usage balance is empty, an organization admin can add extra usage credits at claude.ai/admin-settings/usage. If its monthly spend limit was reached, an admin can raise it on the same page. If neither applies, contact Anthropic support.

Once extra usage is available, someone with write access to this repository can comment @claude review on this pull request to trigger a review.

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 29, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-29T15:07:46.927180Z 76cc85a Draft marked ready
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

@devin-ai-integration devin-ai-integration Bot left a comment •

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note

Newer findings are available below. Devin Review posted a newer report on this PR, in addition to the findings presented here.

🔍 Devin Review: 1 flag

Not posted on this PR by your GitHub settings — view it in Devin Review. (Configure)

Devin Review

@mishushakov
mishushakov enabled stacked auto-merge (squash) October 30, 2026 21:51
devin-ai-integration Bot and others added 10 commits November 13, 2026 21:08
Drop the duplicated second block in api/list.test.ts (keeping one static Sandbox.betaPause call), redundant POST retry cases, the bounded RPC dispatcher case, duplicate handleRpcError Unavailable cases (folding their notInstanceOf checks into the surviving tests), the uncleared handshake timer case and the trivial undici load check.

Co-Authored-By: mish@e2b.dev <mish@e2b.dev>
Co-Authored-By: mish@e2b.dev <mish@e2b.dev>
Co-Authored-By: mish@e2b.dev <mish@e2b.dev>
Co-Authored-By: mish@e2b.dev <mish@e2b.dev>
Drop duplicate/shape-only tests in client, connection config, rpc exception, logging option and idempotency suites; fold the not-SandboxNotRunning assertion into the port-closed mapping test.

Co-Authored-By: mish@e2b.dev <mish@e2b.dev>
Drop tests duplicated by stronger counterparts (secure-mode create/connect/write,
command envs, pty send_input), a no-assertion watch test, a test of the test
module's own wait_for_status helper, and implementation-coupled sync client
lifecycle tests.

Co-Authored-By: mish@e2b.dev <mish@e2b.dev>
…e payload tests

Co-Authored-By: mish@e2b.dev <mish@e2b.dev>
…ync and async

Co-Authored-By: mish@e2b.dev <mish@e2b.dev>
Co-Authored-By: mish@e2b.dev <mish@e2b.dev>
@devin-ai-integration
devin-ai-integration Bot force-pushed the devin/1793224550-remove-irrelevant-sdk-tests branch from 531df79 to 96a4761 Compare November 13, 2026 21:10

@devin-ai-integration devin-ai-integration Bot left a comment

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no bugs or issues to report.

Devin Review

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant