I'm trying to cast my function to an int, add an offset, and cast it back to a function pointer (I don't plan on calling the pointers).

If you're passing a bunch of unrelated arguments to your function, then your function is doing too much and needs to be refactored.