Explanation

The correct structure is "prevent someone from doing something."

So, "He prevented me from going there" is the correct sentence.