Currently, you may use Indexed objects, which are indexed symbols.
There is an ongoing attempt to add Tensor Computer Algebra Capabilities to SymPy, in sympy.tensor.tensor, but that's still evolving and the API is likely not definite.
In sympy.diffgeom you may use tensors as sums of products of differential forms, that is, only fully covariant tensors.