I was born in the U.S., and now almost always take my passport with me as ID when I travel by air (even for flights within the continental U.S.), so I'm not going to say "don't take your passport". But a flight from U.S. soil (mainland U.S.) to U.S. soil (Hawaii) doesn't require that you go through customs or immigration.

