"Apparently he is going to to the conference that they arranged."

[tinimaus]

Could I have said 'onların düzenlediğin konferansa gidiyormuş' instead?

[Ektoraskan]

düzenlediği*

Yes, you can. :)

[tinimaus]

Oops to the typo, thanks to the confirmation :-).