The lights in the store window are turned off _____ midnight.

The lights in the store window are turned off _____ midnight.

Explanation
We use "at" with specific points in time, such as midnight, noon, or 5 PM.
So the correct sentence is: "The lights in the store window are turned off at midnight."