Ancestry and Background
The Bard gets their 1st level Class Feat through their Muse choice so Natural Ambition is a great way to pick up a level Class Feat you might want -- a nice way to pick up Hymn of Healing or Reach Spell.
Weapons
Probably picking up a Whip or Scorpion Whip but the biggest problem we run into as a Bard is that the weapon will rarely be more useful than a Cantrip (even if we invest in a Dedication that provides some bonuses.) We gain Expert in Occult Spellcasting at level 7 but we don't gain the equivalent weapon Expert progression with weapons until level 11. Since the Bard's Key Ability Score is Charisma, it should always be at least one point ahead of Dexterity.
Dedications
Marshal Dedication
The easiest way for us to be Trained in Martial Weapons is with the Warrior Muse but the Human's Versatile Heritage (taking Weapon Proficiency) is probably a better option. This gives us a free skill increase in Diplomacy (we don't need to focus on Intimidation if we pick up the Polymath's Versatile Performance).
I slammed the Bard's Striking ability when weapons were discussed but the Marshal has some good choices even if you avoid the feats like Rallying Charge and Attack of Opportunity.
- Level 2: Marshal Dedication (Diplomacy)
- Level 4: Inspiring Marshal Stance or Steel Yourself!
- Level 6: Cadence Call
- Level 8: To Battle!
You might be wondering why we grab Inspiring Martial stance when it competes with Inspire Courage. Inspiring Martial Stance removes the action tax Bards have with Inspire Courage and it frees up that action for other things; instead of having to decide between Inspire Courage and Dirge of Doom, you can enter Inspiring Martial Stance and spam Dirge of Doom. If you decide to stick with Inspire Courage instead, Steel Yourself! is a great option for providing some extra support for your martial allies.
Shadowcaster Dedication
At the very least, you get a Focus point at 2nd level and a Familiar at 4th level.
Note: Shadow Spells does absolutely nothing for the Bard, all of the spells listed in this feat are on the Occult Spell List.
Dandy Dedication
Two free skill increases at level 2 (Deception and Society become Expert as long as you trained them when you made the character). Gossip Lore is the Bardic Lore equivalent for Society. The Distracting Flattery Skill Feat gets you out of the Dedication at level 4.