You can't use "what with easy conditions" or "house hack" with "particularly to a non-bowler". Everyone knows that even actual bowlers don't understand what easy conditions or house hacks are, so why would average be a poor indicator.
A non-bowler friend asks how well you bowl. As far as they are concerned, that's the same as asking "If we went now to the bowling alley and bowled a few games, what score would you have?". There's nothing wrong with quoting your average to them or telling them how many 300s you have. They simply don't have any reason to feel it's not legitimate, because, as I said, if you went to bowl right then and there, you'd probably shoot close to your average and they'd see that.
The same for most other bowlers.
Now if, say, Pete Weber calls you up and asks about your ability as a bowler, then you can say you're a house hack, that you average 225 on an easy shot but have little experience on harder shots. Or that you can average 205 in a sport league. Or whatever. He'll understand what you tell him. If you try to BS your way into having a "real" 225 average, he'll know you're a house hack.
Different answers depending on who you're talking to are entirely appropriate. Your wife asks what was wrong with the car and you tell her that it was making a "funny noise". Your mechanic asks and you say "there's a scraping sound coming from the engine compartment when I do X".
SH