The SQl Server 2008 R2 Express Edition is installed as default SQL server with VCenter 5.1 and database size limit is 10 GB in SQL 2008 R2.
you have to either install the SQL server 2008 R2 standard Edition so that there is no limitation of database.
The second option is to set the database retention limit in VCenter server data store option.