Viewing Program

Program Data

Program thumbnail for "{props.program.title}"

Title	pyFetch v1
ID	5482075651751936
Created	8 months ago, 1715460442799
Updated	8 months ago, 1715467134721
Code	{"files":[{"code":"\"\"\"\n\nHOW TO USE:\n\nAdd \"from pyfetch import pyfetch, pyJSON\" to the top of your project\n\nFrom there, everything is the same as if you were using javascript's fetch.\nSee https://developer.mozilla.org/en-US/docs/Web/API/Fetch_API/Using_Fetch\n\n\n\n\nSee pyfetch.py notes for technical details.\n\nThese KA queries will change if KA updates their site, so for long latesting API programs I'll probably implement pulling in the latest queries from github.\n\n\"\"\"\n\n\nfrom pyfetch import pyfetch, pyJSON\n\n\n# We can use pyfetch just like we would use fetch in javascript (ignore the editor warnings)\nresponsePromise = await pyfetch(\"https://www.khanacademy.org/api/internal/graphql/hotlist?lang=en\", {\n \"body\": pyJSON.stringify({\n \"operationName\": \"hotlist\",\n \"query\": \"query hotlist($curationNodeId: String, $onlyOfficialProjectSpinoffs: Boolean!, $sort: ListProgramSortOrder, $pageInfo: ListProgramsPageInfo, $userAuthoredContentTypes: [UserAuthoredContentType!]) {\\n listTopPrograms(\\n curationNodeId: $curationNodeId\\n onlyOfficialProjectSpinoffs: $onlyOfficialProjectSpinoffs\\n sort: $sort\\n pageInfo: $pageInfo\\n userAuthoredContentTypes: $userAuthoredContentTypes\\n ) {\\n complete\\n cursor\\n programs {\\n id\\n key\\n authorKaid\\n authorNickname\\n displayableSpinoffCount\\n imagePath\\n sumVotesIncremented\\n translatedTitle: title\\n url\\n userAuthoredContentType\\n __typename\\n }\\n __typename\\n }\\n}\",\n \"variables\": {\n \"onlyOfficialProjectSpinoffs\": False,\n \"curationNodeId\": \"x45aed616\",\n \"sort\": \"HOT\",\n \"userAuthoredContentTypes\": [\n \"PYTHON\"\n ],\n \"pageInfo\": {\n \"itemsPerPage\": 5\n }\n }\n }),\n # \"disableCorsProxy\" : True, # If your api doesn't use cors, you can disable the no cors proxy. \n \"method\": \"POST\",\n})\n\n# As is usual with fetch, we need to await the original fetch and then the .json or .text of the response.\nhotlistPrograms = await responsePromise.json()\n\n# Now we can access the hotlist data like the good ol' days. This will work with any unauthenticated API.\nprograms = hotlistPrograms.data.listTopPrograms.programs\n\nprint(\"Current top hotlist programs:\\n\")\n\nfor program in programs:\n nameBy = \"\\\"\" + program.translatedTitle + \"\\\" ,\\tby \" + program.authorNickname\n print(nameBy)\n\n\nprint(\"\\n\\n\\nSee code for details about how to use pyfetch.\")\n","filename":"main.py","language":"python"},{"code":"\"\"\"\n\npyFetch v1 - https://www.khanacademy.org/python-program/pyfetch-v1/5482075651751936\n\nA python injection implimentation of javascript's fetch\nAnd a python implementation of javascript's JSON\n\n\nBy WKoA, published by proxy.\n\nIf you need help, my discord is wk0a\n\n\nPreviously, fetching APIs did not work because of cors.\nHowever, the backend of servers can ignore cors.\nSo a simple proxy allows you to ignore the \n\"access control\" part of cors.\nSo the issue we were dealing with in PJS was \nthat there were limited urls you could access\ndefined in the CSP (content security polixy), iirc.\nHowever, python runs inside a worker thread.\nThe CSP of a page does not apply to a worker.\nThis means that python can bypass the CSP.\nWe bypass CORs using https://corsproxy.io/\n\nAs to why we can't just use \n\"from js import fetch\", \npython's json is actually a \"dict\".\nSo we need to preprocess with my dict2Array\nbefore we can feed the dict to javascript.\n\nYou could add a translation layer to use\npython's requests module syntax, but\nI prefer fetch because it's less work\nand you can copy browser requests\nfrom devtools network tab in fetch format.\n\n\"\"\"\n\nimport js\n\nfetchInjector = \"\"\"\n// We need to convert from a python dict to json... in javascript, on a Proxy object... This was a pain.\nfunction dict2Array(proxyDict) {\n // Check if this is a dict object, otherwise we can just return it as normal json\n if (proxyDict?.$$flags == 31) {\n const json = {}\n // debugger\n const keys = Array(...proxyDict.keys().mapping)\n keys.forEach( key => {\n value = proxyDict.get(key);\n // If this is another dict, convert it to an array too\n if (value?.$$flags) {\n // Now we know it's a proxy, it could be an array or json\n if (value.$$flags == 31) {\n json[key] = dict2Array(value)\n }\n // Otherwise we'll treat it like an array (may need to add more types later, TODO)\n else {\n json[key] = [...value]\n }\n } else {\n json[key] = value;\n }\n })\n return json;\n } else {\n return proxyDict;\n }\n}\n\nfunction noCorsFetch(url, options) {\n // Modify the URL to ignore cors\n noCorsURL = \"https://corsproxy.io/?\" + encodeURIComponent(url);\n\n jsOptions = dict2Array(options);\n\n return fetch(jsOptions?.disableCorsProxy ? url : noCorsURL, jsOptions);\n}\n\n// Add to global scope so we can extract it\nthis.pyfetch = noCorsFetch\n\n\nfunction pyJSONStringify(dict) {\n json = dict2Array(dict);\n return JSON.stringify(json);\n}\n\nthis.pyJSON = {\n \"stringify\": pyJSONStringify,\n}\n\n\"\"\"\n\n\njs.eval(fetchInjector)\n\n# Extract my function\nfrom js import pyfetch\nfrom js import pyJSON\n","filename":"pyfetch.py","language":"python"}]}
Folds
Fork	false
Key	ag5zfmtoYW4tYWNhZGVteXIXCxIKU2NyYXRjaHBhZBiAgOues73eCQw
Votes	17
Spin-Offs	2
Type	PYTHON
Width	400
Height	400
User Flagged	false
Origin Scratchpad	null
Hidden From Hotlist	false
Restricted Posting	false
By Child	false
Author Nick	Bimum
Author Name	bhavjitAlt
Author ID	kaid_6318969090244505259591687
Author Profile Access	COACH

Archive Data

Added	8 months ago, 1715460687002
Updated	3 months ago, 1728150647761
Source Deleted	unknown