Romans 15:9-11 says:
9Christ also did this so that the non-Jews could give glory to God for the mercy he gives to them. It is written [in the Scriptures]: "So I will give thanks to you among the non-Jewish people; I will sing praise to your name." Psalm 18:49 10The Scripture also says, "You non-Jews should be happy together with God's people." Deuteronomy 32:43 11The Scripture also says, "Praise the Lord all you non-Jews; all people should praise the Lord." Psalm 117:1 (Easy-to-Read Version)
King James Version: 9And that the Gentiles might glorify God for his mercy; as it is written, For this cause I will confess to thee among the Gentiles, and sing unto thy name. 10And again he saith, Rejoice, ye Gentiles, with his people. 11And again, Praise the Lord, all ye Gentiles; and laud him, all ye people.