I believe that Norway's coast would be classified as a passive-margin coast. These coasts are particular because of their tectonic stability in relation to the initial stages of the continental movement away from nearby oceanic rifts or spreading ridges (Hamblin & Christiansen 2001). There are two large oceanic rifts in the surrounding oceanic body (North Sea; Norwegian Sea; Artic Sea). Newer passive margins are characterized by steep cliffs from uplift, but with age the coast subsides as these cliffs erode. The older the coast, the more extensively deltas are able to develop. Moving inland from Norway's coast, you will find wider valleys, most likely, from long term glacial plucking and abrasion and subsequent river erosion. The rivers that run from the remaining glaciers and high mountain run-off become deeper through the coastal fjords as they reach the coast because of increased water velocity the drop in altitude. These rivers are often dammed to create the hydropower that feeds most of Norway's electric needs. The areas where the rivers run through fjord valleys are oceanic bays that allow mixing of the ocean and ground water. Specifically, fjords are deep basin estuaries (UNEP).
Today about 1% of Norway's land surfaces are cover in glaciers. However during the last ice age, the Weichsel glaciation, almost all of Scandinavia was covered by glaciers (biocrawler.com 2007). The accumulation of these glaciers over time has carved out some of Norway's notably picturesque scenery. The U-shaped glacial valleys were formed by the thick year-round movement of alpine ice. The interglacial period followed with increased temperatures causing the glaciers to retreat and the resulting water run-off to flood these glacial troughs can run up to 100 m before they empty into the ocean (Hamblin & Christiansen 2001). The wide bays are usually sandwiched by the steep straight-sided mountains creating the fjords that Norway's coast is famous for. Hanging valleys formed from tributary glaciers provide the backdrop for some of the world's tallest waterfalls (Ham & Roddis 2005).
Sea caves sporadically pepper the coastline (Geology of Norway). Particularly susceptible to this type formation are weaker rocks like limestone (which is not very prevalent along Norway's coast) or other weakness in the coastal bedrock (Strahler & Strahler 2006). These small features are likely near sea level where the persistent wave action uses erosion to hollow out the rounded nook. There are some of these caves that are actually submerged or partially submerged because of a rise in sea water. Most likely, melted ice from deglaciation increases the volume of water in ocean body and drowns some of the caves (Hamblin & Christiansen 2001).