For extra flavor, consider marinating the halibut fillets in lemon juice and herbs for about 30 minutes before baking. Ensure the potatoes are thinly sliced for even cooking and a crispy texture. Feel free to substitute halibut with other firm white fish, such as cod or sea bass.