You might be able to make some basic framing without any sheating without a permit. Then hang your cabinets on that. Best would be to ask your local permit office though. Any new power runs will need a permit regardless.
However, I will say if you want to do any power wood cutting then you'll want to enclose it real well. (ask me how I know, actually on second thought, don't lol)