My first mayo I did the same thing and did not like the flavor at all. With a few oil tests and adjustments I LOVE homemade mayo now....and I wasn't much of a mayo person in general before.
Taste your oil before you make the mayo and find a flavor you like. I did find a trick from Everyday Paleo where she mentioned buying regular olive oil for mayo, NOT extra virgin (I had to hunt around actually for it). You might have to try a couple brands until you find one you like. If you still think it is too overpowering flavor wise, you can cut the olive oil by 25-50% with something more neutral in flavor, like walnut or avocado oil (pricey...but no flavor).
The great thing about the non extra virgin olive oil, suddenly making homemade mayo for me became an inexpensive option.
Here is a link to everyday paleo's post...her recipe has been by far the easiest and most consistent for me (I half the recipe, its all we can use in a week usually).