In the paper a Direct Numerical Simulation (DNS) scheme, named Fluctuating Immersed MATerial (FIMAT) dynamics, for the Brownian motion of particles is presented. In this approach the thermal fluctuations are included in the fluid equations via random stress terms. Solving the fluctuating hydrodynamic equations coupled with the particle equations of motion results in the Brownian motion of the particles. There is no need to add a random force term in the particle equations. The particles acquire random motion through the hydrodynamic force acting on its surface from the surrounding fluctuating fluid. The random stresses in the fluid equations are easy to calculate unlike the random terms in the conventional Brownian Dynamics (BD) type approaches.