Missing header and toolbar after upgrade to 3.3.4

I guess the customizations are still cached, try to empty the cache.
The other thing to check: If you are using a custon theme extension, then you need to adjust this as well. See e.g. Upgrade and custom theme plugins