No, it's not correct. As you suspected, it should be "It might have rained last night." Since "last night" signals that the event is in the past, we should use a past verbal time.