The temple in Jerusalem, first built by Solomon, was the centre of Israel's worship — the place where God chose to put his name and meet with his people through sacrifice. The psalmist longed to dwell there and behold the beauty of the LORD.
Yet Scripture points beyond the building: Jesus called himself the true temple, and believers are now called God's temple, indwelt by his Spirit.
The Temple in Scripture
One thing have I desired of the LORD, that will I seek after; that I may dwell in the house of the LORD all the days of my life, to behold the beauty of the LORD, and to enquire in his temple.