I believe it's a fixed term, so yes you always need it. Think of it like you're 'holding' something 'in' your hands.
Its just a compound verb. So two or more words stick together to have a combined meaning. Like håller i is hold and håller med is agree