Commit Graph

40 Commits

Author SHA1 Message Date
JakubDrobnik
18ecfca288 Small fixes 2018-11-21 12:55:09 +01:00
JakubDrobnik
18d7dc1dab Fixed no results in google maps 2018-11-21 12:30:05 +01:00
JakubDrobnik
e48622d4e8 Fixed small bugs 2018-11-21 12:09:10 +01:00
JakubDrobnik
0ead647234 Improved infinite scroll and other improvements 2018-11-21 11:42:37 +01:00
JakubDrobnik
76ffb133b1 Added fixes 2018-11-20 19:48:04 +01:00
JakubDrobnik
887c5aa084 Fixed typo 2018-11-20 18:46:13 +01:00
JakubDrobnik
600d1be1ee Tried to fix bug with missing element 2018-11-20 18:38:28 +01:00
JakubDrobnik
3b1b16cc8c Update proxy setting 2018-11-20 18:16:44 +01:00
JakubDrobnik
ab3af886f5 Minor fix 2018-11-20 18:00:25 +01:00
JakubDrobnik
8d8dce7ffa Updated readme 2018-11-20 17:55:15 +01:00
JakubDrobnik
3e823db515 Several stability improvements 2018-11-20 17:35:01 +01:00
JakubDrobnik
ec3dff3800 Addad waitting for element 2018-11-20 16:47:32 +01:00
JakubDrobnik
d4bd1748a1 Updated pageFunction timeout 2018-11-20 16:22:06 +01:00
JakubDrobnik
9ab8642b28 Changed how we add place details to queue 2018-11-20 16:21:22 +01:00
JakubDrobnik
cd4e552685 Improved proxy configuration 2018-11-20 15:56:23 +01:00
JakubDrobnik
42a0735093 Added proxy groups on input 2018-11-20 15:50:56 +01:00
JakubDrobnik
633b16c480 ESLinting 2018-11-20 15:41:20 +01:00
JakubDrobnik
389c5aa786 Improved schema 2018-11-20 15:37:52 +01:00
JakubDrobnik
f7a76be8ae Improved schema 2018-11-20 15:36:33 +01:00
JakubDrobnik
433468aed3 Improved schema 2018-11-20 15:35:05 +01:00
JakubDrobnik
732bbaeb14 Improved schema 2018-11-20 15:31:33 +01:00
JakubDrobnik
29e07e02d0 Set up input schema 2018-11-20 15:29:46 +01:00
JakubDrobnik
347207129f Reverted headless mode, it didn't work with that 2018-11-20 15:15:53 +01:00
JakubDrobnik
0905889439 Run in headless 2018-11-20 15:12:30 +01:00
JakubDrobnik
d2415cf044 Tried crawler without useChrome 2018-11-20 15:05:25 +01:00
JakubDrobnik
e4ff7ec417 Improved logging message 2018-11-20 15:00:37 +01:00
JakubDrobnik
4339f7ae56 Added info about adding urls to queue 2018-11-20 14:58:29 +01:00
JakubDrobnik
bf08400b76 Deleted maxOpenPagesPerInstance 2018-11-20 14:56:42 +01:00
JakubDrobnik
d1e3cd4563 Improved infinite scroll, Added persisting of listing state 2018-11-20 14:51:16 +01:00
JakubDrobnik
cf346fb7bc Added console logs for crawler info 2018-11-20 11:52:10 +01:00
JakubDrobnik
48cf0e1596 Deleted useless console.log 2018-11-20 11:42:13 +01:00
JakubDrobnik
6769de702e Added searchViewport to input 2018-11-20 11:40:50 +01:00
JakubDrobnik
ef9aa23bce Added console logs for crawler info 2018-11-19 18:41:46 +01:00
JakubDrobnik
642d83facc useChrome to true 2018-11-19 18:25:55 +01:00
JakubDrobnik
9cc3e856f5 Added longer waiting timeout + live view 2018-11-19 18:17:17 +01:00
JakubDrobnik
6666f0c8a8 Added czech proxy group, hadlepagefuction timeout 2018-11-19 18:12:36 +01:00
JakubDrobnik
cea93bc74e Added Dockerfile 2018-11-19 18:04:29 +01:00
JakubDrobnik
c878cd6a78 Fixed selectors for texts 2018-11-19 17:57:54 +01:00
JakubDrobnik
1b963d9ac5 Version 0.1 2018-11-19 17:56:19 +01:00
JakubDrobnik
86a82b1612 init repository 2018-11-19 11:43:36 +01:00