You’re right. There’s no actual rule in English that you can’t split infinitives. It was copied over from Latin in an attempt to try to come up with some rules for grammar.

Source: Many nerdy discussions with Star Trek geeks about “to boldly go where no one has gone before”