One shouldn't call this a matrix, but more a map or struct or something. A matrix is not just a table, it is the specialisation of a tensor for a given coordinate system (i.e., there must exist a determinant function).

Would you at least say how you insert values into the vector?
http://www.cplusplus.com/reference/stl/vector/