In this research, experimental work has been carried out to check the feasibility of using rubber sludge (RS) to partially replace fly ash (FA) in the production of geopolymer. RS is employed in this study as disposing of RS has led to an issue and is abundant, especially in countries producing rubber products. RS is classified as hazardous waste. Improper awareness on hazardous waste handling can spread a variety of diseases. Therefore, handling of hazardous waste is not easy as competent personnel is required during the collection, transportation, treatment and final disposal. As a result, the cost of disposing the hazardous waste are relatively high. With that, FA incorporated RS geopolymer will able to solve the landfill problems and used it as building materials will save costs, preserve natural resources, and protect the environment from waste impact and hazards. In this study, the physical and mechanical properties were investigated. It was used to replace fly ash at 5 wt.%, 10 wt.%, 15 wt.%, and 20 wt.%. Water absorption, apparent porosity, bulk density, and compressive strength were tested. The test result shows that 5 wt.% of RS incorporation to fly ash-based geopolymer is optimum as it has 1752 kg/m3 of density, 9.5% of water absorption, 19.2% of apparent porosity, and 49.9 MPa of compressive strength.