Can I just stop?

In a word, no. Sudden withdrawal (Cold Turkey) from Benzos is simply not safe. You can suffer seizures and convulsions. Slow and steady and there is no set timetable for coming off – how long it takes to withdraw is a very individual thing