URL too long on https://api.hubapi.com/contacts/v1/lists/all/contacts/all

contacts

#1

Hi,
We need to iterate through all contacts via the API, and fetch all of their properties.
Supplying all properties via the URL does not work (we get HTTP 400),
example URL length below is over 15K chars!?
any ideas? (other than processing properties in subsets)

Example url:
https://api.hubapi.com/contacts/v1/lists/all/contacts/all?hapikey=XXX&count=100&property=accepting_online_bookings&property=address&property=ambassador_type&property=anme&property=annual_revenue&property=annual_revenue_new&property=annualrevenue&property=associatedcompanyid&property=associatedcompanylastupdated&property=behavior_level&property=behavior_score&property=best_time_to_call_&property=bookings_passengers_customers_per_year&property=bookings_per_year&property=browser&property=bw_address&property=bw_alexa&property=bw_company&property=bw_emails&property=bw_facebook&property=bw_spending&property=bw_telephones&property=capterra_lead&property=cc_batch&property=chatcity&property=chatcountry&property=chatipaddress&property=chatstate&property=chaturl&property=chosen_meet_greet_date&property=city&property=closedate&property=comments&property=company&property=company_associated_to_a_deal&property=company_years_active&property=competitor_lost_to&property=competitor_lost_to_why_&property=consultation_completed_date&property=contact_lost_reason&property=contact_lost_reason_marked_date&property=conversion_point&property=country&property=createdate&property=csm_contact&property=currentlyinworkflow&property=date_and_time_of_last_booked_call&property=date_of_birth&property=date_of_last_booked_call&property=date_subscribed_to_blog&property=days_to_close&property=demo_completed&property=demo_scheduled&property=demo_scheduled_on&property=description&property=details&property=distribution_survey_comment&property=do_you_have_a_credit_card_or_a_paypal_account_&property=do_you_know_others_who_would_also_want_to_attend_a_trekksoft_event_&property=edinburgh_meet_and_greet_march_2016&property=email&property=engagements_last_meeting_booked&property=engagements_last_meeting_booked_campaign&property=engagements_last_meeting_booked_medium&property=engagements_last_meeting_booked_source&property=exclude_from_consultation_workflow_&property=fax&property=first_conversion_date&property=first_conversion_event_name&property=first_deal_created_date&property=firstname&property=fit_level&property=fit_score&property=fjord_norway_interested&property=fjord_norway_locations_meet_greet&property=followercount&property=fromurl&property=gender&property=has_been_recycled&property=has_ever_been_mql&property=have_you_used_adwords_before_&property=how_are_you_currently_processing_bookings_&property=how_much_have_you_spent_on_online_advertising_within_the_last_year_&property=how_often_would_you_like_to_hear_from_us_&property=hs_avatar_filemanager_key&property=hs_email_bounce&property=hs_email_click&property=hs_email_delivered&property=hs_email_first_click_date&property=hs_email_first_open_date&property=hs_email_first_send_date&property=hs_email_is_ineligible&property=hs_email_last_click_date&property=hs_email_last_email_name&property=hs_email_last_open_date&property=hs_email_last_send_date&property=hs_email_lastupdated&property=hs_email_open&property=hs_email_optout&property=hs_email_sends_since_last_engagement&property=hs_emailconfirmationstatus&property=hs_facebookid&property=hs_googleplusid&property=hs_ip_timezone&property=hs_lead_status&property=hs_lifecyclestage_customer_date&property=hs_lifecyclestage_evangelist_date&property=hs_lifecyclestage_lead_date&property=hs_lifecyclestage_marketingqualifiedlead_date&property=hs_lifecyclestage_opportunity_date&property=hs_lifecyclestage_other_date&property=hs_lifecyclestage_salesqualifiedlead_date&property=hs_lifecyclestage_subscriber_date&property=hs_linkedinid&property=hs_persona&property=hs_predictivecontactscore&property=hs_sales_email_last_clicked&property=hs_sales_email_last_opened&property=hs_sales_email_last_replied&property=hs_sequences_is_enrolled&property=hs_social_facebook_clicks&property=hs_social_google_plus_clicks&property=hs_social_last_engagement&property=hs_social_linkedin_clicks&property=hs_social_num_broadcast_clicks&property=hs_social_twitter_clicks&property=hs_twitterid&property=hubspot_owner_assigneddate&property=hubspot_owner_id&property=hubspot_team_id&property=hubspotscore&property=i_am_a&property=i_am_also_interested_in_&property=i_d_like_to_meet_individually_instead_this_time_from_sat_26_mon_28works_for_me_&property=if_you_were_to_pick_one_aspect_from_trekksoft_that_most_interests_you_what_would_it_be&property=incoming_lead_date&property=industry_accelerator_support&property=industry_air_helicopter_balloon_tours&property=industry_city_sightseeing_tours&property=industry_cruising_sailing_boat_tours&property=industry_dmc&property=industry_food_wine_nightlife&property=industry_multi_day_tours&property=industry_outdoor_activities&property=industry_reseller&property=industry_water_sports&property=industrydropdown&property=initial_touchpoint&property=integration_specialist_contact&property=interview_group&property=ip_city&property=ip_country&property=ip_country_code&property=ip_latlon&property=ip_state&property=ip_state_code&property=ip_zipcode&property=ipaddress&property=isp&property=italian_region&property=jobtitle&property=joined_mql_list&property=kloutscoregeneral&property=language&property=last_booking_date&property=last_consultation_requested_date&property=last_date_signed_up_for_a_meet_greet&property=last_demo_request_date&property=last_login_date&property=lastmodifieddate&property=lastname&property=latest_nps_score&property=latest_nps_survey_comment&property=latest_nps_survey_date&property=latitude&property=lead_status_put_to_open_date&property=leadin_accetto_i_7fc214fe158635f3c9c5dec006e9adc3&property=leadin_american_english_7901b4d7fdf6108ad257e66bd2291388&property=leadin_amerikanisches_englisch_fcd4ae242d446abcdb8fd3f0a7fffb1b&property=leadin_anglais_amricainkqb_e190ea53184d8e92adb95478bab52145&property=leadin_argentina_3536be57ce0713954e454ae6c53ec023&property=leadin_ars__peso_argentino_40daa505afc3aa68f0f824df9db062d4&property=leadin_british_english_cce196ee016c01540ba8baf072949f80&property=leadin_city_head_office_se_requiere_un_valor_este_campo_no_puede_qu_4caa054d9b492e187885094a28278d96&property=leadin_colombia_ef3388cc5659bccb742fb8af762f1bfd&property=leadin_cop__peso_colombiano_963840334de5a1ab3ed68b6134834095&property=leadin_costa_rica_5882b568d8a010ef48a6896f53b6eddb&property=leadin_deutsch_8f0ca2185f684aa4edeae4b25a65239b&property=leadin_deutschland_3c2f8b8c8c43538b25a0327ae84c3f65&property=leadin_disfruta_de_soporte_directo_de_nuestros_expertos_para_poner__d0c146146dda11870367749167ed6197&property=leadin_el_nombre_de_usuario_puede_ser_una_direccin_de_correo_electr_e7a4304a671afbf6dbea68978b36e6e8&property=leadin_enter_city_or_town_a11b25d290743ac5ccfc585b2db3b270&property=leadin_entry1965132719_43258ca93b296728be213df4f61432b4&property=leadin_entry2114423441_fbed26cd27dc0fe2555def82e9938deb&property=leadin_erhalten_sie_livesupport_von_unseren_experten_sie_erreichen__c5d40bd3d87006d0b62c272ad0f25f85&property=leadin_es_muy_recomendable_cambiar_la_contrasea_una_vez_que_hayamos_39dc2efaf23f2fc96f74fa7b48546f54&property=leadin_escribe_tu_ciudad_o_pueblo_2a0e254d05b005323880d9ac0f6900be&property=leadin_espaarta_f13d2458f0fdc34fa96621ea44c46663&property=leadin_espaol_de_espaa1qbk_a23d699e38ff31d81a292c2cc7282870&property=leadin_eur__euro_1385ab6de9624cc90ce6b9972cc1d79c&property=leadin_europisches_spanischfzb_bed857280e67fbcdd85424beb27ac45e&property=leadin_gbp__british_pound_6d05c6eee49ee97ec9d03eacb09ded40&property=leadin_godaddy_11_etc___username_to_log_into_your_domain_registrar_0fb8ae57877b747e1daf68323aa9c2ac&property=leadin_godaddy_1__1_etc___nombre_de_usuario_para_acceder_a_su_regis_4f288fe020144cb520df973c6cf68e22&property=leadin_i_agree_to_the_trekksoft_dc45cb15cc8899007cb848701fbf4bcc&property=leadin_i_agree_to_the_trekksoft_terms_of_service_please_read_and_ac_aa7535b5744c29457339f03f3134cdba&property=leadin_ich_akzeptiere_die_trekksoft_f2ad90bdd71cba4283bbd0cd950c1105&property=leadin_id_322215_dccd7e54f62689cb2cb755ddd539cd14&property=leadin_id_431194_d011b0a0f0efdbc59ff09765b3b7f0a0&property=leadin_id_859656_a4a5c37f290085b8eaeb4c43635d2eae&property=leadin_id_859661_a4c3e3f2592fa76aea951896ae23e31d&property=leadin_ihr_nachname_9698b7dc4551b16575e342f917ba866b&property=leadin_ihr_vorname_64c4a3b08b5cccb9e6d7991bd62ee5e7&property=leadin_il_tuo_cognome_e28a770a31ea5847cd8d3172d3f58a10&property=leadin_il_tuo_nome_9d28283785e9be45d9b0368405b74fb8&property=leadin_indonesia_4647d00cf81f8fb0ab80f753320d0fc9&property=leadin_inglese_britannico_ab1723f42af4e3b30810e02e664d7c54&property=leadin_ingls_estadounidensee2b_859b3fb5da2aade16c5e2b8d32da98b9&property=leadin_inserisci_la_citt4ob_bbc54877cb59b20ec2a5de9738150f95&property=leadin_ireland_06e415f918c577f07328a52e24f75d43&property=leadin_irlanda_a242a786a14c15f8e8293dc8180470d9&property=leadin_italia_2dd54eeecb4fc052da43cc77321ab74e&property=leadin_italiano_ccb14d6f3212fde822299d00d24a4ebf&property=leadin_kolumbien_e6e0a5d22319abfcfee60ca9621436f8&property=leadin_los_dominios_que_desea_asignar_a_su_sitio_web_trekksoft_incl_91dd27b4e5cc10561675bd6e55cb3b05&property=leadin_maroc_ce6b272197a8c0f6b26179322fa8d5a7&property=leadin_marruecos_84a9ae154e5c6345371b08128948b829&property=leadin_mxicobsa_aa08f208d3f17498891bb4c0b041b1ce&property=leadin_nmero_de_telfono_se_requiere_un_valor_este_campo_no_puede_qu_7548eb9d95a57cc5ac15ac3ff16d76f8&property=leadin_nom_de_famille_f7684e77781981683235221df8ac4b67&property=leadin_nombre_de_la_empresa_lisyx_es_menor_que_6_caractres___var_fi_85c43aebaa6bdcde9cb075d4d0553dd9&property=leadin_nombre_de_la_empresa_lisyx_es_menor_que_6_caractres_nmero_de_711042cbd82b8b09a882850df1cad7aa&property=leadin_nombre_de_la_empresa_se_requiere_un_valor_este_campo_no_pued_3792d9c731328142966c3f5ac4148548&property=leadin_nous_pouvons_afficher_votre_site_web_sur_votre_profil_en_lig_798daca39c1e6a3daf1aec968206bc5e&property=leadin_nous_pouvons_connecter_ce_profil_avec_votre_compte_7dfdda98808794fc24edd62d50f7e961&property=leadin_ottieni_assistenza_in_tempo_reale_dai_nostri_esperti_disponi_e24c7fdb3ca3b8bcd006add26167a82a&property=leadin_pases_bajospcb_fe94f27f522d3914fcd2704f0aeada3e&property=leadin_pen__nuevo_sol_peruano_d48bdd1ed22964165aaed34a10287da7&property=leadin_perboa_3a8816f44eb05cff17bca6042549ea7c&property=leadin_podemos_conectar_esta_cuenta_con_la_tuya_de_trekksoft_1fab7ffeed90715b12b23b55a9887964&property=leadin_podemos_mostrar_su_web_en_su_perfil_online_803368c79a0067dfa1f2339681a50c25&property=leadin_seychellen_648ab33009bcb2fe8a3763be32ed163f&property=leadin_south_africa_c89bc418c38da77213c6c6e03cac2510&property=leadin_spagna_9ef12a22fed6c13099c77155db106fbd&property=leadin_stadt_eingeben_84a2118bd3a0829b8217f90669299173&property=leadin_sterreichuya_b472f5868425ac2bc44e693fc3267e87&property=leadin_telefon_nummer_die_angabe_ist_obligatorisch_und_darf_nicht_l_9fa81109d72a49e8a9b79472a8e23b76&property=leadin_the_domains_you_wish_to_map_to_your_trekksoft_website_includ_91e30483ed70a5d5f8ac7fdeeb114338&property=leadin_trinidad_and_tobago_63965a52775c39cd64c3ef0248d585b1&property=leadin_tu_apellido_b237f163dd19d81eab1ea2e541691690&property=leadin_tu_nombre_51dfcd6a75d54d537a685e28438a7884&property=leadin_turkey_221cdfb73049678e244380b45872cbb2&property=leadin_united_kingdom_89f9c9f489be2a83cf57e53b9197d288&property=leadin_unsubscribe_me_from_all_mailing_lists_9f7c4ae247310dcc4785b7863eb6fe2a&property=leadin_url_de_tripadvisor_si_is_not_a_profile_id_containting_only_d_923c5a3d4a6eab6b2fc0c29722c89d17&property=leadin_usd__us_dollar_c5ad90a808f9e8eeaddcd5de739d5e36&property=leadin_var_fieldsthathaveerrorsjson_____bitte_berprfen_sie_den_firm_c0c2a8c42ad32d7d8744db36a5553902&property=leadin_var_fieldsthathaveerrorsjson_____por_favor_compruebe_el_nomb_41a70b3cd7a58829ad325c5700e507a2&property=leadin_vous_prnomh7a_6f1db36c2acb17e4994580377010733d&property=leadin_we_can_connect_this_profile_with_your_trekksoft_account_72d09efccbcd972b64fb394522a605f0&property=leadin_we_can_display_your_website_in_your_online_profile_aff1fb05f4c6a7c6596c7e6a1d561018&property=leadin_wir_knnen_ihre_webseite_in_ihrem_onlineprofil_anzeigen_lasse_005c24085b8d0fc2ebb6f116da48e51f&property=leadin_your_activities_company_a60e7c65aadf252a69853c4f306dc03b&property=leadin_zar__south_african_rand_5941fed3b6e6dd27c598bd2d1e89ea03&property=lf_downloaded_first_ebook&property=lifecyclestage&property=linkedinbio&property=linkedinconnections&property=longitude&property=marital_status&property=marked_as_not_interested&property=marketing_budget&property=meet_greet_location&property=merchant_id&property=message&property=military_status&property=mobilephone&property=moved_to_open_date&property=my_company_s_biggest_challenge_is_&property=myobis_customer&property=new_content&property=notes_last_contacted&property=notes_last_updated&property=notes_next_activity_date&property=num_associated_deals&property=num_contacted_notes&property=num_conversion_events&property=num_notes&property=num_unique_conversion_events&property=number_of_employees_new&property=numemployees&property=numero_di_cellulare&property=old_contact_lost_reason_before_reactivation&property=onboarding_phase&property=online_advertising_spent&property=operatingsystem&property=other&property=past_customer&property=phone&property=photo&property=pipedrive_id&property=plugins&property=preferred_language&property=question&property=rc_became_a_customer_date&property=rc_became_a_marketing_qualified_lead_date&property=rc_became_a_sales_qualified_lead_date&property=rc_became_an_opportunity_date&property=rc_marked_as_not_interested_date&property=reached_out_date&property=reactivation_date&property=reactivation_reason&property=read_terms_and_conditions&property=reason_to_unsubscribe&property=recent_conversion_date&property=recent_conversion_event_name&property=recent_deal_amount&property=recent_deal_close_date&property=recycled&property=referred_by&property=relationship_status&property=reseller_code&property=responded_customer_check_up_survey&property=salutation&property=sdr_demo_arranged_date&property=sdr_owner&property=sdr_owner_date_assigned&property=send_me_tips_dropdown&property=send_me_tips_on_how_to_generate_more_bookings&property=sessions&property=signup_date&property=skype&property=snapengageurl&property=source&property=spanish_region&property=stand_number&property=state&property=store_enabled_date&property=sub_industry&property=subject&property=surveymonkeyeventlastupdated&property=test&property=test_contact_&property=test_test&property=time&property=time_zone&property=total_revenue&property=tour_operator_enter_your_trekksoft_url&property=transcript&property=trekksoft_url&property=trial_expiration&property=trigger&property=tripadvisor_profile&property=twitterbio&property=twitterhandle&property=twitterprofilephoto&property=type_of_demo_requested&property=vidyard_most_recent_player&property=vidyard_players&property=vidyard_video_attention_span&property=visited_demo_last_date&property=visited_features_last_date&property=visited_pricing_last_date&property=walking_biking_tours&property=webinar_topic_date&property=webinareventlastupdated&property=website&property=when_would_you_like_your_future_solution_to_be_live_and_online_&property=who_takes_care_of_your_website_and_it_&property=work_email&property=zip


#2

@Frederic_Laruelle If you need every property the best way is to use the Get Contact by ID endpoint.

I understand this will take a lot of API calls but the get all endpoint wasn’t made to be that verbose intentionally to limit the possibility of a network timeout due to a huge payload.


#3

Understood, however we have many joint customers :slight_smile: and many of them have contact lists in the 100K+ range…
What’s more, we are unable to fetch just the contacts that have been updated in the past day or so, so we have to fetch them all every time.
Adding filtering by last updated date would greatly help as well…


#4

@Frederic_Laruelle You could potentially set up a webhook to fire off from hubspot each time the contact has been updated. You could set it around the contact property “Last Updated”


#5

Webhook is a no go for us… we refresh each of our client’s data daily, we are not setup to listen to third party systems such as hubspot.


#6

@Frederic_Laruelle You have two options then

  1. would be to loop through all of your contacts one by one.

  2. You could try the batch endpoint as I believe that returns the majority of the contact properties by default