Start by washing the small red potatoes thoroughly. Cut them into quarters if they are larger.
Place the potatoes in a large pot and cover them with water. Bring to a boil over high heat, then reduce to a simmer and cook until the potatoes are fork-tender, about 15 minutes.
Once cooked, drain the potatoes in a colander and let them cool to room temperature.
In a mixing bowl, combine the mayonnaise, Dijon mustard, apple cider vinegar, garlic powder, onion powder, salt, and black pepper. Whisk together until smooth.
Add the cooled potatoes to the dressing mixture, along with the chopped dill, diced celery, chopped red onion, and hard-boiled eggs.
Gently stir to combine all ingredients, ensuring the potatoes are well coated with the dressing.
Taste and adjust seasoning if necessary, adding more salt or pepper as desired.
Refrigerate the potato salad for at least 30 minutes to allow the flavors to meld before serving.
Garnish with extra dill or sliced green onions if desired before serving.