Preheat oven to 325 degrees F. Butter and flour a 10-inch loaf pan. In a medium bowl, whisk together flour, baking powder, and salt. In a large bowl, beat eggs until loosened. Add sugar and beat until pale and foamy, about 2 minutes. With beaters running, add olive oil and beat until combined. Stir in fennel seeds. Beat in flour mixture until just combined. Fold in figs. Pour batter into prepared loaf pan and bake until golden and a cake tester comes out clean, about 45 minutes.