The first Church to occupy the Miller-Ridge Streets site was described as a "neat temporary church got up in a few weeks".

The church was of wood construction and was visited by Archbishop Polding in March 1856. This temporary church was not named but it was aligned east-west with the main entrance at the east end from Miller Street which is the alignment of the present church.

When the second parish priest, Dean Father John Kenny arrived in 1867, he quickly set about providing a new permanent church for the 450 Catholics of the North Shore.

On 28 June 1868, Archbishop Polding opened and dedicated this new church to the Mother of God under the title of "Saint Mary Star of the Sea". Built to accommodate 150 people seated, the church was of Gothic design with gabled roof and pointed arch stained glass windows. The alignment of this church however reversed that of the temporary church so that the main entrance faced the present primary school and the altar and the rear wall of the church has its back to Miller street.

By 1893, the Parish Priest of the time, Father Brennan SJ decided that with some 2,000 Catholics attending the church, some major alterations would have to be made.

On 6 October 1895, Cardinal Moran blessed the cornerstone for these new alterations which almost doubled the size of the stone Gothic Church. These additions and alterations were dedicated by Cardinal Moran on 7 September 1896.

It was this church of 1896 that was pulled down, beginning on 12 July 1937. The Gothic Church of Saint Mary Star of the Sea was to be replaced by the present Mary Immaculate Church. The present church was completed and officially opened by Archbishop Gilroy on 4 December 1938, the Sunday prior to the Feast of the Immaculate Conception.

The parish priest at the time, Fr O’Mara SJ was also justly proud in 1938 for it was the year that marked the Diamond Jubilee of the arrival of the Jesuits at the parish of North Sydney.

The present church does have some reminders of the earlier church. The outer stone wall of the church is the stone used for the older church. The Shrine of Our Lady of the Way contains a floor of marble taken from the old sanctuary, while the stained glass windows in the Shrine are from the old church. The side aisle pews also date from the older church of Father Brennan (1893) while at the back of the side aisles the very old pews date from Dean Kenny’s time (1867).

The foundation stone for the present St Mary’s Church was laid and dedicated by the then Co-adjutor Archbishop of Sydney, Dr N.T. Gilroy on 21 November 1937. This stone can be seen underneath the east end of the confessional window on the left hand side as one enters the church.

The history of St Francis Xavier Church is closely linked with the arrival of the Jesuits at St Mary’s North Sydney. In 1878, Archbishop Vaughan invited the Jesuits from Melbourne to take charge of the North Shore Parish. Founded in 1856, it extended along the coast from North Head to Palm Beach and was bounded in the north by the Hawkesbury River and in the west by Berowra Creek with a line drawn to the Lane Cove River. The harbour formed the southern boundary.

St Francis Xavier Church at Lavender Bay was the fifth of the North Shore parish churches. Apart from the mother church at St Mary’s, the others were at Pymble 1857 (called Lane Cove), Manly Beach 1868, Pittwater 1875 and Milson’s Point 1880 (Star of the Sea).

The first two Jesuits to arrive from Melbourne were Fathers Joseph Dalton and James Kennedy.

In July 1878, Father Dalton purchased from the Hon. Francis Lord approximately three acres of land lying north of the newly formed Mackenzie Street and bounded by Blue, Walker and Miller Streets, at a cost of ₤3000. The plan was to erect a school, a church, and, in time, a presbytery, but the first would be a school which could be also used as a church.

The need for a place of worship was lessened when in 1880 the Jesuit Fathers purchased a small stone church at Milsons Point. The church had been built 17 years earlier as a Congregational Church. This became the original Star of the Sea Church which served that section of the parish until the new Star of the Sea Church was finished a quarter of a mile away in 1970.

The foundation stone of the school which was to become St Francis Xavier Church, was laid in March, 1879. The design of architect Wardell was followed by Mr John Young in building the school-church. Locally quarried stone was used.

Archbishop Vaughan administered Confirmation on 23 January 1881 at St Mary’s North Sydney, then travelled down the hill preceded by two bands, the Parish Guilds, children and parishioners, to open the completed building.

The building, seventy feet long and thirty feet wide, contained four classrooms. There was a verandah on each side, one terminating in the front end of the porch and the other in a tower with a porch underneath. The tower was finished by a bell column and a lead spire reaching roughly one hundred feet high.

In 1901 it was decided to erect a new school in the grounds alongside the original building at a cost of over ₤2000. The foundation stone was blessed by Cardinal Moran on 22 September 1901. St Francis Xavier Church, which had always looked more like a church than a school, could now be a place of worship.

Until 1880, Jesuits serving the Lavender Bay section of the parish lived with the North Sydney Jesuit community. In this year the Jesuits working at Lavender Bay looked around for a residence nearer the church. Fr Gately SJ and Fr Corish SJ were appointed fulltime to the parish. In 1913 "Wangan" was bought and is now the site of the present Parish Centre, 20 Mackenzie Street, Lavender Bay.

In 1922, Lavender Bay became a parish separate from North Sydney and Fr Richard Murphy SJ, Assistant Priest at North Sydney, came as its first parish priest. A man of wide interest and great achievements, he founded the guild of St Luke for medical practitioners, was co-founder (with Dr S Minogue) of Alcoholics Anonymous in Australia, and author of the book The Catholic Nurse as well as being a popular retreat giver. He was succeeded by Fr Magan SJ, a wartime chaplain long remembered for his hearty laugh and sense of fun. In his time Our Lady of Lourdes Grotto was erected in the Church grounds as a memorial to Fr O’Dempsey SJ who, in the inscription there, is incorrectly named as the first Parish Priest.

The church was much narrower than it is now. The central altar was of wood and built well out from the back wall of the sanctuary. Flanking the main altar were two side altars, on one of which was a statue of the Sacred Heart and on the other a statue of Our Blessed Lady.

Fr Stone SJ who was Parish Priest from 1944 to 1948 and again from 1954 to 1959, had a plan to build a new church of St Francis Xavier on the higher level facing Miller Street and for this reason the small duplex of flats and four cottages on the corner of Miller and Mackenzie Streets were purchased. These had been built on land originally bought by the Jesuits who later sold them.

Fr Kevin Staunton SJ was Parish Priest for eight years from 1962, and during these years extensive changes were made.

Instead of building a new church at Lavender Bay, he enlarged the existing one. The north wall was removed and the church extended towards the station to double its original size. The new north wall was constructed of about one thousand feet of glass (beautifully coloured "Loire" slabs) set in concrete. It was the work of Stephen Moor and was put together on the site.

The renovations were completed in 1964. Father Staunton had the painted Stations of the Cross stripped during his period, revealing exquisite wood-cuts which had been carved in the 1860’s by Josef Dettlinger of Friburg-in-Breisagau, Germany. They remain today.

The money for the extensive parish projects at this time was made possible not only through sacrificial giving of the parishioners, but also by the sale of that section of the presbytery grounds bounded by Walker and Mackenzie Streets. This later became the Ampol car park and is now the site of Lavender Terraces.

Star of the Sea Church, Kirribilli was blessed and opened by Cardinal Gilroy on Sunday 21 June 1970.

Father Caulfield-James SJ, young and energetic, arrived in 1970 and during his year at St Francis Xavier Parish helped establish the Sunday evening Folk Mass which is still a distinctive feature of its liturgical life.

In 1990 Star of the Sea Kirribilli became a part of Neutral Bay parish and Lavender Bay became part of North Sydney Parish. The Jesuits returned to St Mary’s Presbytery and 20 Mackenzie Street has become a centre for hospitality, prayer and a home for the Pastoral Associates.

When Our Lady Star of the Sea became part of the North Sydney parish on 1st January 2002 it could be said that the wheel had come full circle. It was returning to its source of origin. Since 1856 there had been a church under the patronage of "Our Lady, Star of the Sea" at Ridge St North Sydney. When the Jesuits took over the parish in 1878, they saw the need for a church in Milson's Point to accommodate the growing numbers of parishioners there. They purchased the Congregational Church at Milson's Point, which went out of use in 1869. The new church was blessed by Archbishop Vaughan on 7th November 1880. It was given the name, "Our Lady, Star of the Sea". To avoid confusion, the church at Ridge St from then on was known as "St Mary's".

In 1903 "Star of the Sea" became the chapel for St Aloysius College, which has just moved from Surry Hills into a large house next to the church. In 1940 extensive alterations were made to the church. A refurbished sanctuary and sacristies were built, the entrance and porch were moved to the northern end facing Pitt St. Further changes were carried in the early 1950s to bring the building into line with the modern trend towards simplicity in church furnishings, while at the same time drawing on present day materials and techniques.

Towards the end of the decade some people believed that neither the site nor the size of the church satisfied the requirements of the area. After 1965 "Star of the Sea" was no longer used for worship and parishioners were invited to attend the new college chapel at St Aloysius. But this arrangement proved unsatisfactory. Maybe they pined after their dearly loved little stone church. At any rate an ascent of twenty-six steps daunted the older and less agile parishioners.

Land was bought in Willoughby St, Milson's Point and a new church was built and it retained the name, "Our Lady, Star of the Sea". Cardinal Gilroy blessed and opened the church on the feast of St Aloysius 21st June 1970. It is post Vatican II in design and modern in style and structure.

The former "Star of the Sea", which the present one replaced, came to a sad end. It was demolished to make way for the further development of St Aloysius College, much to the chagrin and distress of many former parishioners and others.