How many cuda kernel calls are involved in the evaluation of a jit compiled function?

[cgel]

After operation fusion is done, is every remaining operation computed with an individual kernel call, or is the whole jitted function computed into a single cuda kernel?

[hawkinsp]

XLA will fuse operations into a sequence of kernels for each jit computation. Usually it will be more than one kernel.