Preheat the oven to 350° F.
Poke some holes in each baby potato with a fork.
Place the potatoes in a single layer on a lined or greased baking sheet.
Drizzle the olive oil on top of the potatoes.
Add salt and pepper to taste.
Bake the potatoes for 15 minutes.
Pull the potatoes out of the oven and cut each one in half. Be careful as the potatoes and pan will be extremely hot! I left my oven mitt on to hold each potato with while I cut it in half.
Place the potato halves face up on the baking sheet.
Pop the potatoes back into the oven to bake for another 5 - 10 minutes, or until they are nice and soft on the inside.
Let the potatoes cool for a bit, then flip them over so they are face down on the baking sheet.
Smash the top of each potato down with a fork.
Plate the smashed potatoes.
Garnish the potatoes with paprika and your herb of choice.
Dig in and enjoy with whichever dipping sauce you'd like.