"My books are few."
Translation:Buku saya sedikit.
Does it actually mean 'I don't have many books'? Or is it 'I have a few books' or 'I have few books'?
Yes, that's correct.
"I have (a) few books" is the meaning of the Indonesian sentence.
The English sentence (My books are few) is the literal translation of the Indonesian sentence.
"sedikit" = "a liitle (bit)" , "a few", "some" , "not much".