As explained in the sixth edition of the "Publication Manual of the American Psychological Association," most APA style citations use the author's last name and the publication year in the text and give the rest of the source’s bibliographical information on a reference page. Because they are so widely recognized, citations for classical sources such as Biblical psalms follow different guidelines.
In APA style, the in-text citation for a psalm includes more specific information about the reference, so you do not include the Bible on your references page. Instead of a page number, the parenthetical citation lists the book, chapter and verse with a colon between the chapter and verse. Since the wording differs among versions of the Bible, your first reference must also include the name of the version you are referring to, as in this example: (Psalm 86:5, King James Version.)