I think a little translation would be something like "It was sad to/for him yesterday." So, було refers to 'it.' However, the meaning translates to "He was sad yesterday," which is the source of confusion, since the subject changes between the literal and figurative translations.