No need to complicate this. It's an easy issue.
The answer is NO. Any withdrawals from a ROLLOVER IRA will have NO EFFECT on your unemployment benefits.
Again - the answer this is NOT earned income. Once rolled over, these monies are now your private retirement account and outside the pervue of NYSDOL.
OP has clearly stated this is NOT a pension. It IS or WILL BE a withdrawal from a rollover IRA the source of which was his pension account.
Once that money is in a private IRA, it is considered personal retirement monies - no matter the employer may be the source.
The only time this would be considered a "pension" would be if the money was not rolled over, but, instead, came directly from the company to OP as a weekly/monthly pension, or as a direct withdrawal from a 401k to which the employer contributed.

