Don't detach manual tests by default by DavertMik · Pull Request #280 · testomatio/check-tests

DavertMik · 2026-09-22T18:50:56Z

Manual tests pushed with check-tests push or check-tests manual are no longer marked as detached by default. To detach them anyway, pass the new --detached flag.

	no flag	`--detached`	`--no-detached`
manual / push	not detached	detached	not detached
automated	detached	detached	not detached

This PR also fixes push, which merged options as { ...opts, ...globalOpts }. That let the top-level default (detached: true) override push --no-detached.

🤖 Generated with Claude Code

Manual tests (check-tests push / check-tests manual) always send no-detach, while automated frameworks keep detaching unmatched tests by default. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

Also fix push merging options so its own --no-detached/--detached is not overridden by the top-level default. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

github-actions · 2026-09-22T18:55:07Z

🌀 Tests overview by Testomatio

Found 274 mocha tests in 27 files
No new tests added or removed

📑 List all tests

📝 tests/analyzer_test.js

📎 analyzer
- ✔️ can import analyzer from main index
- ✔️ should parse all mocha files
- ✔️ should parse all typescript files
- ✔️ should exclude dir in file name if dir specified
- ✔️ should include full dir in file name
- ✔️ should avoid node_modules
- ✔️ should read char`
- ✔️ should not load dirs as files
- ✔️ should exclude files matching exclude pattern
- ✔️ should exclude specific file patterns
- ✔️ should work without exclude option
- 📎 env variable params
  - ✔️ should prepend a dir from env variable
  - ✔️ should parse TypeScript files with ES2023 Explicit Resource Management
  - ✔️ should sort files alphabetically
  - ✔️ should maintain consistent file order across multiple runs

📝 tests/codeceptjs_test.js

📎 codeceptjs parser
- 📎 create todo tests
  - ✔️ should parse codecept file
  - ✔️ should include code
- 📎 Parse CodeceptJS tags
  - ✔️ should include tags
- 📎 Parse CodeceptJS tags & datatable
  - ✔️ should include data and tags
- 📎 Parse CodeceptJS hooks code - default opts
  - ✔️ should include Before hook code
  - ✔️ should include BeforeSuite hook code
  - ✔️ should include AfterSuite hook code
- 📎 [opts.noHooks = true] Parse CodeceptJS hooks code
  - ✔️ should exclude Before hook code
  - ✔️ should exclude BeforeSuite hook code
  - ✔️ should exclude AfterSuite hook code
- 📎 Parse CodeceptJS test with --line-numbers option
  - ✔️ [lineNumbers=true opts] each section should include line-number as part of code section
  - ✔️ [no SET the lineNumbers opts] should exclude line-number
  - ✔️ [noHooks=true + lineNumbers=true opts] line-number as part of code section

📝 tests/comment_test.js

📎 Comment
- ✔️ should refer to proper skipped line in comment

📝 tests/decorator_test.js

📎 Decorator
- ✔️ should print markdown
- ✔️ should validate tests with empty titles
- ✔️ should print markdown2

📝 tests/error_message_test.js

📎 formatErrorMessage
- ✔️ should format 504 responses without a body
- ✔️ should use server body message when response has a body
- ✔️ should keep regular Error messages
- ✔️ should not return undefined for plain objects

📝 tests/gauge_test.js

📎 gauge parser
- 📎 basic gauge specs
  - ✔️ should parse specification title as suite
  - ✔️ should parse scenarios as tests
  - ✔️ should extract steps as test code
  - ✔️ should handle line numbers correctly
- 📎 gauge specs with tags
  - ✔️ should handle tags correctly
  - ✔️ should parse multiple scenarios with tags
  - ✔️ should include tables in test code
- 📎 gauge specs with alternative format
  - ✔️ should parse underlined specification title
  - ✔️ should handle scenario tags
- 📎 edge cases
  - ✔️ should handle empty file
  - ✔️ should handle file with only specification
  - ✔️ should handle file with no tags
- 📎 with options
  - ✔️ should respect noHooks option
  - ✔️ should respect lineNumbers option

📝 tests/jasmine_test.js

📎 jasmine parser
- 📎 jasmine tests
  - ✔️ should parse jasmine file
  - ✔️ should include code

📝 tests/jest_test.js

📎 jest parser
- 📎 jest tests
  - ✔️ should parse jest file
  - ✔️ should include code
- 📎 exclusive tests
  - ✔️ should throw an error if a file contains .only
- 📎 hooks tests - default opts
  - ✔️ should include beforeAll hook code
  - ✔️ should include beforeEach hook code
  - ✔️ should include afterAll hook code
- 📎 [opts.noHooks = true] hooks tests
  - ✔️ should exclude beforeAll hook code
  - ✔️ should exclude beforeEach hook code
  - ✔️ should exclude after hook code
- 📎 test with --line-numbers option
  - ✔️ [lineNumbers=true opts] each section should include line-number as part of code section
  - ✔️ [no SET the lineNumbers opts] should exclude line-number
  - ✔️ [noHooks=true + lineNumbers=true opts] line-number as part of code section
- 📎 jest concurrent
  - ✔️ shuld parse it.concurrent
  - ✔️ should parse test.concurrent
- 📎 ES2023 Explicit Resource Management tests
  - ✔️ should parse jest file with using keyword without errors
  - ✔️ should find test with using declaration
  - ✔️ should include code with using keyword

📝 tests/manual_test.js

📎 manual (markdown) parser
- 📎 markdown manual tests
  - ✔️ should parse markdown file
  - ✔️ should extract suite information
  - ✔️ should mark tests as manual
  - ✔️ should include test metadata
  - ✔️ should not include test content in code property
  - ✔️ should set correct line numbers
- 📎 markdown multiple-suites
  - ✔️ should parse markdown file with multiple suites
  - ✔️ should extract all suites information
- 📎 single-line comments /
  - ✔️ should extract all suite information for suites with single-line comments
  - ✔️ should extract all test information with single-line comments
- 📎 mixed single-line and multiline comments
  - ✔️ should parse file with mixed single-line and multiline comments
- 📎 tags / labels comma-separated metadata (arrays)
  - ✔️ should split tags by comma, trim segments
  - ✔️ should yield empty array when tags key has no values
  - ✔️ should parse single tag without comma
  - ✔️ should parse labels like tags (comma split, trim)
  - ✔️ should yield empty labels array when empty value

📝 tests/mocha_test.js

📎 mocha parser
- 📎 mocha tests
  - ✔️ should parse mocha file
- 📎 cypress tests
  - ✔️ should parse cypress file
  - ✔️ should include code
- 📎 cypress tags
  - ✔️ should sync tags from describe config to tests
  - ✔️ should combine suite tags with test tags
  - ✔️ should inherit tags from all parent suites
  - ✔️ should not add tags to tests without them
  - ✔️ should parse tags of skipped tests
- 📎 graphql tests
  - ✔️ should parse codeceptjs internal test
- 📎 Cypress: hooks tests
  - ✔️ should include before hook code by default
  - ✔️ should include beforeEach hook code by default
  - ✔️ should include after hook code by default
- 📎 [opts.noHooks = true] Cypress: hooks code
  - ✔️ should exclude before hook code
  - ✔️ should exclude beforeEach hook code
  - ✔️ should exclude after hook code
- 📎 Cypress: test with --line-numbers option
  - ✔️ [lineNumbers=true opts] each section should include line-number as part of code section
  - ✔️ [no SET the lineNumbers opts] should exclude line-number
  - ✔️ [noHooks=true + lineNumbers=true opts] line-number as part of code section

📝 tests/newman_test.js

📎 newman parser
- ✔️ should parse newman collection
- ✔️ should properly get test name
- ✔️ should properly get suites for test inside nested folder
- ✔️ should properly get suite for test within collection (not in any folder)

📝 tests/nightwatch_test.js

📎 nightwatch parser
- ✔️ should parse basic nightwatch describe/it tests
- ✔️ should parse mixed patterns with skipped tests
- ✔️ should parse module.exports pattern (JavaScript)
- ✔️ should parse TypeScript nightwatch tests with describe pattern
- ✔️ should parse TypeScript nightwatch tests with hooks (ecosia example)
- ✔️ should parse TypeScript nightwatch tests with module exports pattern
- ✔️ should handle hooks correctly
- ✔️ should forbid .only tests
- ✔️ should handle no-hooks option
- ✔️ should parse classic Nightwatch CommonJS syntax
- ✔️ should parse page objects pattern
- ✔️ should parse complex classical Nightwatch tests with hooks
- ✔️ should handle @tags and metadata in classic syntax
- ✔️ should handle classic Nightwatch with custom commands
- ✔️ should parse classic Nightwatch ESM syntax
- ✔️ should parse TypeScript Nightwatch export default pattern

📝 tests/playwright_test.js

📎 playwright parser
- ✔️ should parse basic playwright-js tests
- ✔️ should forbid describe.only tests
- ✔️ should parse basic playwright-ts tests
- ✔️ should parse multiple playwright-js tests
- ✔️ should parse multiple playwright-ts tests
- ✔️ should update playwright suite if no suite set
- 📎 tags
  - ✔️ should parse playwright-ts test with signle tag on the same line
  - ✔️ should parse playwright-ts test with opening brace on the same line and signle tag on the next line
  - ✔️ should parse playwright-ts test with signle tag on the next line
  - ✔️ should parse playwright-js test with multiple tags
  - ✔️ should parse playwright-js test with multiple tags on multiple lines
- 📎 annotations
  - ✔️ should parse playwright test with single annotation
  - ✔️ should parse playwright test with multiple annotations
  - ✔️ should parse playwright-ts tests with params
  - ✔️ should parse playwright-js tests with annotation
  - ✔️ should parse playwright-js tests with annotation including fixme
  - ✔️ should parse playwright-ts tests with annotations
  - ✔️ should parse playwright test with test.skip annotation inside a test
  - ✔️ should parse playwright-js tests with skip() annotation for the description and test sections
  - ✔️ should parse playwright-js tests with fixme() annotation for the description and test sections
- 📎 Parse Playwright hooks code - default opts
  - ✔️ should include beforeAll hook code
  - ✔️ should include beforeEach hook code
  - ✔️ should include afterAll hook code
- 📎 [opts.noHooks = true] Parse Playwright hooks code
  - ✔️ should exclude beforeAll hook code
  - ✔️ should exclude beforeEach hook code
  - ✔️ should exclude afterAll hook code
- 📎 **Default playwright file parsing **
  - ✔️ should parse basic playwright-ts DEMO tests ("todo" name as part of inner function args)
  - ✔️ should return suite name if used test.describe without parallel mode
  - ✔️ should return suite name if used test.describe.parallel mode
  - ✔️ should return suite name if used test.describe.serial mode
- 📎 test with --line-numbers option
  - ✔️ [lineNumbers=true opts] each section should include line-number as part of code section
  - ✔️ [no SET the lineNumbers opts] should exclude line-number
  - ✔️ [noHooks=true + lineNumbers=true opts] line-number as part of code section
  - ✔️ should parse playwright test with custom alias (fixture/test name)
  - ✔️ should parse annotations (.skip/.fixme/.fail) on a custom test alias
  - ✔️ should not parse custom alias annotations when the alias is not configured
- 📎 annotations status (.skip/.fixme/.fail/.slow)
  - ✔️ registers every named test exactly once (runtime no-title forms excluded)
  - ✔️ keeps .fail tests runnable (not skipped)
  - ✔️ keeps .slow tests runnable (not skipped)
  - ✔️ treats .fail inside a skipped suite as skipped
  - ✔️ ignores runtime test.fail()/test.skip()/test.slow() calls without a title
  - ✔️ should not leak a skipped suite onto sibling tests declared after it
  - ✔️ should not crash when test is assigned to a variable or inside an array (regression for issue #1)

📝 tests/pull_test.js

📎 Pull
- 📎 pullFiles
  - ✔️ should create files from server response
  - ✔️ should create directories if they do not exist
  - ✔️ should overwrite existing files
  - ✔️ should handle empty files response
  - ✔️ should handle server errors
- 📎 dry run mode
  - ✔️ should not create files in dry run mode
  - ✔️ should show what files would be created
- 📎 file tree display
  - ✔️ should display file tree after successful pull
- 📎 git checks
  - 📎 non-empty directory without git
    - ✔️ should exit with error when directory has files but no git
    - ✔️ should pass when directory is empty and no git
    - ✔️ should pass when directory has only hidden files and no git
  - 📎 git repository with dirty working tree
    - ✔️ should exit with error when working tree is dirty
    - ✔️ should pass when working tree is clean
  - 📎 force mode
    - ✔️ should bypass git checks with force mode
    - ✔️ should bypass dirty working tree check with force mode

📝 tests/push_command_test.js

📎 push command
- ✔️ should be available as a command
- ✔️ should process markdown files like manual command
- ✔️ should accept same options as main command
- ✔️ should produce same output as manual command
- ✔️ should handle directory option correctly
- ✔️ should accept a single file path via --files
- ✔️ should accept multiple file paths via --files
- ✔️ should accept a glob pattern via --files
- ✔️ should accept a file path inside a subdirectory via --files
- ✔️ should expose --files option in --help output
- ✔️ should work with empty directory (finds tests in current project)

📝 tests/qunit_test.js

📎 qunit parser
- 📎 qunit tests
  - ✔️ should parse qunit file

📝 tests/require_ids_test.js

📎 --require-ids functionality
- ✔️ should pass when all tests have Testomat.io IDs
- ✔️ should detect tests missing Testomat.io IDs
- ✔️ should ignore skipped tests when checking for missing IDs

📝 tests/testcafe_test.js

📎 testcafe parser
- 📎 Testcafe tests
  - ✔️ should parse testcafe file
  - ✔️ should include testcafe code

📝 tests/update_fs_test.js

📎 UpdateIds FS
- ✔️ should add suite and test ids
- ✔️ should clean suite and test ids safely
- ✔️ should clean suite and test ids unsafely

📝 tests/updateIds_codeceptjs_test.js

📎 update ids tests(codeseptJS adapter)
- 📎 [codeseptJS examples] includes Feature + Scenario
  - ✔️ [js file]: file includes Feature + one Scenario
  - ✔️ [js file]: test file does not include Feature, only Scenario
  - ✔️ [js file]: test file does not include Scenario, only Feature
- 📎 [codeseptJS examples] clean-ids
  - ✔️ can remove ids from the file with Scenario only
  - ✔️ can remove ids form the Feature & Scenario

📝 tests/updateIds_gauge_test.js

📎 Gauge update-ids
- 📎 updateIdsGauge
  - ✔️ adds suite IDs to specification titles
  - ✔️ adds test IDs to scenario titles
  - ✔️ handles underlined specification titles
  - ✔️ handles underlined scenario titles
  - ✔️ prevents duplicate ID addition
  - ✔️ replaces previously added IDs (suite and tests)
  - ✔️ handles simple key matching
  - ✔️ handles tags in titles
- 📎 cleanIdsGauge
  - ✔️ removes specific suite and test IDs
  - ✔️ removes all IDs in dangerous mode
  - ✔️ handles underlined format cleaning
  - ✔️ preserves original formatting when cleaning

📝 tests/updateIds_markdown_test.js

📎 updateIds markdown
- 📎 updateIdsMarkdown
  - ✔️ should add ID to test metadata
  - ✔️ should add ID to suite metadata
  - ✔️ should update existing ID
  - ✔️ should handle metadata without ID field
  - ✔️ should add ID to test and suite with tags in name
  - ✔️ should handle markdown with multi suites
  - ✔️ should expand single-line  and  and add IDs
  - ✔️ should expand single-line comments and assign IDs to correct suites
  - ✔️ should skip tests without metadata comment
  - ✔️ should accept an array of patterns and update every matched file
  - ✔️ should accept an array of glob patterns
- 📎 cleanIdsMarkdown
  - ✔️ should remove ID from metadata
  - ✔️ should handle multiple IDs in file
  - ✔️ should accept an array of patterns

📝 tests/updateIds_nightwatch_test.js

📎 update ids for nightwatch
- 📎 classical nightwatch format
  - ✔️ should update ids in classical nightwatch syntax
  - ✔️ should update ids in classical nightwatch with ESM syntax
- 📎 describe/it nightwatch format
  - ✔️ should update ids in describe/it nightwatch syntax
- 📎 clean ids
  - ✔️ should clean ids from classical nightwatch syntax
  - ✔️ should clean ids from describe/it nightwatch syntax

📝 tests/updateIds_playwright_test.js

📎 update ids tests(playwright adapter)
- 📎 [Playwright examples] includes/no includes main suite
  - ✔️ [ts file]: test file includes suite with tests
  - ✔️ [ts file]: test file does not include suite name, only tests
  - ✔️ [ts file]: test file test.describe.parallel mode should returns updated title.
- 📎 [Playwright examples] lines processing
  - ✔️ [ts file]: the same import name as suite name
  - ✔️ [ts file]: test file without imports should update only suite & test name
  - ✔️ [js file]: the same require name as suite name
  - ✔️ [js file]: suite name as a new line
  - ✔️ test.skip() annotation inside a test is propersly processed
- 📎 [Playwright examples] clean-ids for the --typescript mode
  - ✔️ can remove ids from the file with suite
  - ✔️ can remove ids if no suites in the file

📝 tests/updateIds_test.js

📎 update ids
- 📎 update-ids
  - ✔️ should update id by title
  - ✔️ should update id with tags by title
  - ✔️ updates ids from server
  - ✔️ ignore duplicates for ids from server
  - ✔️ should not update other strings in file
  - ✔️ allows multi-line titles
  - ✔️ respects string literals
  - ✔️ respects variables in string literals
  - ✔️ respects variables in string literals and JSON report mode
  - ✔️ respects variables in string literals in double param and JSON report mode
  - ✔️ works ok with empty files
  - ✔️ supports typescript
  - ✔️ supports typescript with types
  - ✔️ should not reformat the Array code with --typescript option
  - ✔️ should update nested scenarios
  - ✔️ should update ids based on filename for suites with included nested suites
- 📎 clean-ids
  - ✔️ cleans up ids from strings
  - ✔️ cleans up ids from string literals
  - ✔️ unsafely cleans up ids from string literals
  - ✔️ can remove ids from typescript

📝 tests/utils_test.js

📎 util functions
- ✔️ #replaceAtPoint
- 📎 #getAllSuiteTags
  - ✔️ should return empty array when no suites provided
  - ✔️ should return empty array when suites have no tags
  - ✔️ should collect tags from a single suite
  - ✔️ should collect tags from multiple suites
  - ✔️ should handle mixed suites with and without tags
  - ✔️ should not modify original suites array

DavertMik and others added 2 commits September 22, 2026 21:50

Never detach manual tests on push

397b529

Manual tests (check-tests push / check-tests manual) always send no-detach, while automated frameworks keep detaching unmatched tests by default. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

Add --detached flag to opt manual tests into detaching

355d4bd

Also fix push merging options so its own --no-detached/--detached is not overridden by the top-level default. Co-Authored-By: Claude Opus 5.5 (1M context) <noreply@anthropic.com>

DavertMik changed the title ~~Never detach manual tests on push~~ Don't detach manual tests by default Sep 22, 2026

DavertMik merged commit dbf5161 into master Sep 23, 2026
1 check passed

DavertMik deleted the manual-no-detach branch September 23, 2026 08:51

Navigation Menu

Repository navigation

Don't detach manual tests by default - #280

Don't detach manual tests by default#280
DavertMik merged 2 commits into
masterfrom
manual-no-detach

DavertMik commented Sep 22, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Sep 22, 2026

Uh oh!

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

DavertMik commented Sep 22, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

github-actions Bot commented Sep 22, 2026

Uh oh!

Uh oh!

Reviewers

Uh oh!

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

DavertMik commented Sep 22, 2026 •

edited

Loading