iOS keychain cannot be accessed in unit tests

[odrobnik]

A unit test accessing the iOS keychain fails when run via xctool but works when run via xcodebuild.

This issue has first been described here

Here are my own tests, look at the bottom of the build log:

• with xctool, failure "No keychain is available. You may need to restart your computer"
• with xcodebuild: the tests pass

[LegNeato]

Yeah, this is likely because we don't run unit tests in the simulator context. Apple has been moving this direction for a bit now and we plan to go that way too.

[odrobnik]

Pray tell how to do that

[LegNeato]

It will require some xctool changes unfortunately. This was a change Apple did in the underlying system in Xcode 5. We have it on the todo to run unit tests in the simulator context, which will solve issues like this.

As a workaround, you can either swizzle or turn the test into an integration test (which runs in the simulator).

[odrobnik]

Please explain how to "turn the test into an integration test".

[grp]

I think @LegNeato means an application test, which means you'd set the TEST_HOST and BUNDLE_LOADER build settings to an app to run the test inside of. If it's just for this, you can make an empty app for that.

[LegNeato]

Yeah, sorry I used the wrong terminology!

[ExtremeMan]

Fixed since we have switched to use simctl to run logic tests (6b59d20). I've checked against the https://github.com/danielalves/NitroKeychain project. All tests are passed.

[lordkev]

I'm still getting "No keychain is available. You may need to restart your computer" with 0.2.7. Tests run fine using xcodebuild.

@ExtremeMan Is there something else I need to do to get it working with the switch to simctl?

[ExtremeMan]

Hm. Are your tests application tests, @lordkev?

[lordkev]

@ExtremeMan: No, unit tests.

[ExtremeMan]

@lordkev, can you try moving the test to application tests? (xcodebuild is launching tests in Simulator.app context, but xctool for performance is not doing that for logic tests).

[lordkev]

@ExtremeMan I'll give it a shot, but I'm kind of confused about your comment from Aug 13 about simctl fixing the issue and the tests on the NitroKeychain passing. Was that only when changing them to run as application tests?

[ExtremeMan]

Hm, my comment is about logic tests, true. I will need a sample project which I can use to test. Can you help me with that?

[lordkev]

Just realized - in our case it's tests for a framework, so there isn't really any application to host it. NitroKeychain is still a good test project. I just verified that with xctool 0.2.7 three of 16 tests fail, but with xcodebuild all tests pass.