The Ghana FA announced the news on Twitter but did not give the reason for his death.
It's claimed Yakubu died in a hospital in the southern Ghanaian city of Tema on Tuesday.
"We're sad to hear the death of former Ghana, Ajax and Vitesse midfielder Abubakari Yakubu, our thoughts are with his family may his soul RIP," the Ghanian FA tweeted.
Yakubu won 16 caps for Ghana and helped his country qualify for the 2006 World Cup.
A versatile player who slotted into defence when required, Yakubu won the Dutch league and cup double in 2002 and added another league title in 2004.