Graphql cards dont export in the same order

Hi Tim, 

Thanks for the time, 

I coded some python to use the IDs to headers, put me in trouble with empty fields. Also the python requests from graphql seems to dont work very well cause sometimes it returns a list, and others a dictionary.

Here below are my code, any sugestion is welcome, i am kind of starter with DataScience and API integrations

import requests
import json
import pandas as pd
import numpy as np

colunas ={}                
x={}              
ids = []
indice = []
campos = []
valores=[]
nomes = []
titles = []
hope={}

p1 = '********** '
coluna1=[]
p2 = '********** '
coluna2 = []
p3 = '********** '
coluna3 = []
p4 = '********** '
coluna4 = []
p5 = '********** '
coluna5=[]
p6 = '********** '
coluna6=[]

url = "https://api.pipefy.com/graphql"

headers = {
    "Accept": "application/json",
    "Authorization": "Bearer **************************",
    "Content-Type": "application/json"
}

todos = {"query": "{allCards(pipeId:*********, first:40) { edges { node { id title fields { name value }}} pageInfo {endCursor startCursor}}}"}

response = requests.request("POST", url, json=todos, headers=headers)
print(response)
dados = json.loads(response.text)

menu = dados["data"] #All Data -> Dict
infos = menu['PageInfo'] #Selecting page info for pagination-> Dict, this selection keeps returning me error
cards = menu["allCards"] #Selecting the cards only-> Dict

edges = cards["edges"]# -> List

for i in range(len(edges)): #Inser all cards IDs as lines at the DF
    valor = edges[i]['node']['id']
    ids.append(valor)
    
for i in range(len(edges)):
    card = edges[i]['node']['fields'] #This line run across all cards
    for t in card: #This line select the field inside the card
        indicador = t['name']
        if indicador == p1:
            coluna1.append(t['value']) 
        if indicador == p2:
            coluna2.append(t['value'])
        if indicador == p5:
            coluna5.append(t['value'])
        if indicador == p6:
            coluna6.append(t['value'])

tMarketing = pd.DataFrame(ids)  #Create the DF and insert the columns in it

tMarketing[''********** ''] = np.array(coluna2)

tMarketing[''********** ''] = np.array(coluna1)

tMarketing[''********** ''] = np.array(coluna5)

tMarketing[''********** ''] =np.array(coluna6)

tMarketing.columns=[''********** ', ''********** ' ', ''********** '', ''********** '', ''********** '']

print(tMarketing)

#Clean the columns for the next request
ids *= 0
coluna2 *= 0
coluna1 *= 0
coluna5 *= 0
coluna6 *= 0

Dear @tsartori ,

I see, nice work! I attached the code how I would recommend to write it below. A few notes:

1. The code is as I recommended: independent on the field names and order. This makes it a bit shorter, as an additional benefit.
2. The pageInfo issue you had was two-fold: there was a typo (PageInfo → pageInfo) and you requsted it on the data rather than the allCards. There are two points where you can check for these errors: a) in the GraphQL Query: the syntax and hierarchy is the same as in there, and b) in the response JSON: print(response.text), look at it with a JSON-prettifier and see on which object you can access with which key.
3. The name of the fields are used as the header in the DataFrame (except for the id). This is not save if you have more than one field with the same name; in this case, I would recommend to use the field id or internal_id instead.
4. I hope the comments are useful in-code, otherwise feel free to reply here.

import requests
import json
import pandas as pd
import numpy as np

url = "https://api.pipefy.com/graphql"

headers = {
    "Accept": "application/json",
    "Authorization": "Bearer *********",
    "Content-Type": "application/json"
}

todos = {"query": """{
  allCards(pipeId:*********, first:40) { 
    edges { node { id title fields { name value }}
  } pageInfo {endCursor startCursor}}
}"""}

response = requests.request("POST", url, json=todos, headers=headers)
print(response.text)
dados = json.loads(response.text)


menu = dados["data"]  # All Data -> Dict
cards = menu["allCards"]  # Selecting the query's response -> Dict
infos = cards['pageInfo'] # Selecting page info for pagination -> Dict

edges = cards["edges"]  # -> List

# the collection of dicts: one per card / row in the dataframe
allCardsDataDicts = []

for i in range(len(edges)):
    # thisCardDataDict will become one row in the DataFrame
    thisCardDataDict = {
        "id": edges[i]['node']['id']
    }
    fields = edges[i]['node']['fields']
    for field in fields:  # loop all fields in the card that the API got back (i.e. non-empty)
        # use the name of the field as a column name
        thisCardDataDict[field['name']] = field['value']

    # append the row to the to-be dataframe
    allCardsDataDicts.append(thisCardDataDict)

tMarketing = pd.DataFrame(allCardsDataDicts)  # Create the DF and insert the columns in it

print(tMarketing)