You assumed he was turning left when he was making a U-turn on PCH (or was he turning into the service road, essentially, two lefts). Either way you failed to yield to someone with the right of way.
Remember, two wrongs don't make a right, but three lefts do.