Testing completion handler APIs with Swift Testing – Donny Wals

The Swift testing framework is an extremely great tool that enables us to put in writing extra expressive exams with handy and trendy APIs.

That is my first submit about Swift Testing, and I’m primarily writing it as a result of I wished to put in writing about one thing that I encountered not too way back once I tried to make use of Swift testing on a code base the place I had each async code in addition to older completion handler based mostly code.

The async code was very straightforward to check because of how Swift Testing is designed, and I shall be writing extra about that sooner or later.

The completion handler base code was a bit of bit more durable to check, primarily as a result of I used to be changing my code from XCTest with check expectations to regardless of the equal could be in Swift testing.

Understanding the issue

Once I began studying Swift testing, I truly checked out Apple’s migration doc and I discovered that there’s an one thing that’s presupposed to be analogous to the expectation object, which is the affirmation object. The examples from Apple have one little caveat in there.

The Swift Testing instance appears a bit of bit like this:

// After
struct FoodTruckTests {
  @Check func truckEvents() async {
    await affirmation("…") { soldFood in
      FoodTruck.shared.eventHandler = { occasion in
        if case .soldFood = occasion {
          soldFood()
        }
      }
      await Buyer().purchase(.soup)
    }
    ...
  }
  ...
}

Now, as you may see within the code above, the instance that Apple has reveals that we have now a perform and a name to the affirmation perform in there, which is how we’re supposed to check our async code.

They name their previous completion handler based mostly API and within the occasion handler closure they name their affirmation closure (referred to as soldFood within the instance).

After calling setting the occasion handler they await Buyer().purchase(.soup).

And that is actually the place Apple desires us to pay shut consideration as a result of within the migration doc, they point out that we wish to catch an occasion that occurs throughout some asynchronous course of.

The await that they’ve as the ultimate line of that affirmation closure is absolutely the important thing a part of how we needs to be utilizing affirmation.

Once I tried emigrate my completion handler based mostly code that I examined with XCTestExpectation, I did not have something to await. My authentic testing code seemed a bit of bit like this:

func test_valueChangedClosure() {
  let anticipate = expectation(description: "Anticipated synchronizer to finish")

  let synchronizer = Synchronizer()
  synchronizer.onComplete = {
    XCTAssert(synchronizer.newsItems.depend == 2)
    anticipate.fulfill()
  }

  synchronizer.synchronize()
  waitForExpectations(timeout: 1)
}

Primarily based on the migration information and skimming the examples I although that the next code could be the Swift Testing equal:

@Check func valueChangedClosure() async {    
  await affirmation("Synchronizer completes") { @MainActor verify in
    synchronizer.onComplete = {
      #anticipate(synchronizer.newsItems.depend == 2)
      verify()
    }

    synchronizer.synchronize()
  }
}

My code ended up wanting fairly much like Apple’s code however the important thing distinction is the final line in my affirmation. I’m not awaiting something.

The outcome when working that is at all times a failing check. The check is just not ready for me to name the verify closure in any respect. That await proper on the finish in Apple’s pattern code is just about wanted for this API to be usable as a alternative of your expectations.

What Apple says within the migration information whenever you fastidiously learn is definitely that the entire confirmations need to be referred to as earlier than your closure returns:

Confirmations perform equally to the expectations API of XCTest,
nevertheless, they don’t block or droop the caller whereas ready for a
situation to be fulfilled. As a substitute, the requirement is predicted to be confirmed (the equal of fulfilling an expectation) earlier than affirmation() returns

So each time that affirmation closure returns, Swift Testing expects that we have now confirmed all of our confirmations. In a standard completion handler-based setup, this would possibly not be the case since you’re not awaiting something as a result of you do not have something to await.

This was fairly tough to determine.

Write a check for completion handler code

The answer right here is to not use a affirmation object right here as a result of what I assumed would occur, is that the affirmation would act a bit of bit like a continuation within the sense that the Swift check would look ahead to me to name that affirmation.

This isn’t the case.

So what I’ve actually discovered is that one of the best ways to check your completion handler-based APIs is to make use of continuations.

You should utilize a continuation to wrap your name to the completion handler-based API after which within the completion handler, do your whole assertions and resume your continuation. This can then resume your check and it’ll full your check.

Right here’s what that appears like for example:

@Check func valueChangedClosure() async {
    await withCheckedContinuation { continuation in
        synchronizer.onComplete = {
            #anticipate(synchronizer.newsItems.depend == 2)
            continuation.resume()
        }

        synchronizer.synchronize()
    }
}

This method works very properly for what I wanted, and it permits me to droop the check whereas my callback based mostly code is working.

It is the best method I may give you, which is often a superb signal. However in case you have every other approaches that you just choose, I might love to listen to about them, particularly when it pertains to testing completion handler APIs. I do know this isn’t a full-on alternative for every thing that we are able to do with expectations, however for the completion handler case, I feel it is a fairly good alternative.

When to not use continuations for testing completion handler code

The method of testing outlined above assumes that our code is considerably freed from sure bugs the place the completion handler isn’t referred to as. Our continuation does not do something to forestall our check from hanging endlessly which may (let’s be sincere, will) be a problem for sure situations.

There are code snippets on the market that can get you the power to deal with timeouts, just like the one discovered on this gist that was shared with me by Alejandro Ramirez.

I have never performed intensive testing with this snippet but however a few preliminary exams look good to me.