While there are a few plugins that provide shortcodes for displaying list of x number of recent posts, you will have more control of the HTML output by registering your own shortcode.
This members-only tutorial provides the steps to register a custom shortcode that outputs an unordered list of latest posts in WordPress.
[latestposts]
will output 3 latest posts.
A num parameter can be passed to specify the desired number of posts that should be shown.