The neighbor won't care or the cops wont care?

Also, is it a crime if they are smoking in their backyard? I can only judge be the smell that it is marijuana but could be wrong...