We use 'would' to express presumption or expectation in the past or present. The use of 'knew' puts the timing of the presumption in the past.
Present presumption. 'I am sure he would be happy to see you'. 'That would be Steve at the door.'
Would is always followed by the infinitive without 'to', so your sentence is correct without 'be'.