You could use either.
'From,' would be more common if talking about the name of the bank that you are getting the loan from.
But you could certainly use 'at,' if you were talking about the immediate future - for example telling a friend about your plans for tomorrow.