8000 No way to get xcresult from running logic tests · Issue #26 · google/xctestrunner · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
No way to get xcresult from running logic tests #26
Open
@segiddins

Description

@segiddins

xctestrunner currently assumes that any test without a test host (a logic test) must be run directly via the xctest agent, and not via xcodebuild test-without-building. This means there's no way to get an xctestresult bundle from logic tests, making it much harder to analyze what happens during the run of a log test.

Changing xctest_session.py to not check if test_type != ios_constants.TestType.LOGIC_TEST, and unconditionally run logic tests via xcodebuild seems to work just fine, and is "just" slower:

Direct:
Stats over 10 runs: max = 1.0s, min = 0.9s, avg = 0.9s, dev = 0.0s

Xcodebuild:
Stats over 10 runs: max = 2.9s, min = 2.7s, avg = 2.7s, dev = 0.1s

Xcodebuild, with the sleeps shortened:
Stats over 10 runs: max = 2.5s, min = 2.2s, avg = 2.2s, dev = 0.1s

Would an option to run logic tests via xcodebuild be acceptable?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0