There are wrong spaces among words and incorrect punctuation, otherwise it is grammatically right and appropriate sentence.
==> 나 도서관에 가서 리포트 마저 해야 하는데, 같이 갈래?
However, the meaning is a little bit different from your English sentence.
Literal exact translation is
나 도서관에 가서 리포트 써야 하는데, 같이 갈래?
"마저 해야 하는데" means "I already started it but have to finish it"