Actors Doing Extras Work

I'm an actor & I've been thinking about doing some extras work just to kill some time & make a bit of cash - but I'm worried about becoming 'known' as an extra. Do you think doing extras work could have a negative affect on an emerging actor's career?