"Look there" is correct. "Look at there" isn't. Instead you could say "Look at that". Look there: Correct Look at there: Incorrect Have a nice day!:)

Look there: correct Look at there: incorrect -> You would need a different preposition: Look up there, Look down there, Look over there Look at that: correct