The series of bomb blasts and gunfight by Islamic State sympathizers last month killed eight people, four of whom were the attackers themselves.
Police have since apprehended 19 people, six of whom they said were directly related to the attack, in several regions across the country.
Another five were arrested by counter-terrorism squad Densus 88 during raids in three separate locations late on Friday in Malang, said National Police chief Gen. Badrodin Haiti.
The five people are part of the military wing of the Jamaah Ansar Khilalaf Daulah Nusantara (JAKDN). The JAKDN was formed in March 2015 and comprises IS supporters who have allegedly sent Indonesians to fight alongside the extremist group in Syria.
The JAKDN consists of a number of known terrorist cells in Indonesia, including the East Indonesia Mujahidin, the West Indonesian Mujahidin, Jamaah Islamiyah and Jamaah Ansharut Tauhid.
Of the 19 people previously apprehended, 18 are still detained, while one person has been released due to insufficient evidence.