What are signs that I should stop wearing my orthotics?

Orthotics can be worn full-time. But when you feel like your feet have become stronger, and usually, after consulting with a podiatrist, it's possible to reduce the time you wear them and only wear them during certain activities (e.g. sports, long periods of standing). Gradually reduce the time you wear them, to give yourself time to adjust.