Currently the most accurate possible answer to that question is "sort of". From a distance it looks like a point charge but the closer you look the fuzzier the picture gets because the point charge is always surrounded by a sea of virtual particles, and the closer you look the denser that sea becomes.
If you find that explanation unsatisfactory and you are unable to form a mental picture of what's going on then welcome to the club. Even the man who invented renormalization, Richard Feynman, was not shy about saying something didn't smell right about it despite it being able to make experimental predictions with fantastic accuracy, in fact the most accurate predictions in all of science.