The blue battery light in the center of your mouse is not meant to stay on. This is the normal behavior of the mouse.
When you turn your mouse on or replace the batteries, the light will come on for a few seconds. This indicates that the battery has enough charge for your mouse to work.
The light will go off after a few seconds to conserve battery power.