on peut dire "au fait" ou "à propos"

"by the way" in French is "par la même occasion"

On peut aussi dire " en passant"

I have heard "en bref" used as "by the way", in the sense of "just one quick thing". For example: "En bref, ta lettre est arrivée."

"En passant"