Love the idea, but strange UX.

Edit: tried it again and I think the problem is that there's no feedback during scrolling during transition screens. When I scroll, I expect it to scroll with me, not go on its own path. So by the time it's possible to scroll again, I already tried everything and gave up. Made more confusing by the instructional text disappearing between transitions. Give a little bit more feedback during those transitions and I think the problem goes away.