I actually have a VERY similar or same problem. I initially thought my compressor shit the bed because i hardly ever use A/C. After driving the piss out of the car it began to rain, so i turned the A/C on because the window was fogging and low and behold it was hot. Not cold at all. A few weeks later it i turned it on again because of rain but it was fine. Over the weekend, i was driving the piss out of it again and once again hot.
I noticed this time though that once i let the air run for a long time and on defrost the air eventually (long time like 20-30 mins) it went cold.
Something else i noticed, maybe with yours as well? if its blowing the hot air, i noticed that my car gets cooler on the driver side first before the passenger. the vent closest to the driver door is always the coldest one (though not that cold) and i can feel it try to become colder over time. Meanwhile passenger vents are hot.
Edit:
forgot to mention what it could be. Someone told me that there is a valve up on the passenger side engine bay area. (not exactly sure where but i was told its easy to get to). Basically i was told this valve is getting stuck and not allowing the cold air to get into the cabin. Similar to a thermostat getting stuck for the engine. Someone with more knowledge might be able to answer.