Use ScraperWiki to Help Turn Web Pages Into Usable Data

Av
With scraping you create programs that reads and organize web pages. For example to get your bank account data into a spreadsheet. (There are still banks that doesn't help you to do that!)

A post from Lifehacker by Dave Drager has the whole story. Here is a part:

 

 Dave Drager — A scraper is a program written to take content off of a webpage or other data source and turn it into some kind of usable format, usually an RSS feed or by entering it directly into a database. Designing a scraper can be tricky as each site is different,ScraperWiki aims to fix this by creating a repository of these scripts with a goal to ease the pain of designing them.
An example use of a scraper: let's say a government entity releases daily information regarding finances, and you want to graph or otherwise track this data for personal or business use. Going to the website each day and entering the data manually is certainly one labor-intensive way to do it, but as with any good hacker will tell you - if you have to do anything more than once it is better to automate it.

Populære innlegg fra denne bloggen

Predicates in Core Data

Av
Database programming is all about filtering and sorting tables linked to each other. According to the book Core Data , «Core Data is Apple’s object graph management and persistency framework for iOS, OS X, watchOS, and tvOS.» In a sense, predicates are an object version of the WHERE clause in SQL. Just like NSFetchRequest represent the FROM clause in SQL. I never have had problems with WHERE and FROM in SQL, but the predicate format strings in Core Data has been quite a struggle for me. I don’t think the struggle is only my fault. Predicates should clearly be thought, at least to me, as a method of writing WHERE clauses. Here is some notes from tutplus’ Core Data and Swift: Relationships and More Fetching : let predicate = NSPredicate(format: "%K == %@", "last", "Doe") The predicate format string uses %K (K stands for Key) for the property name and %@ for the value. let predicate = NSPredicate(format: "%K >= %i", ...
More...

Hva er den egentlige forskjellen på høstens nettbrett?

Av
Google selger allerede et godt 7’ nettbrett, Nexus, og Microsoft og Amazon har annonsert sine nye som kommer i oktober/november. Rykter vil ha det til at Apple kommer med en iPad Mini i oktober. Alle nettbrettene synes å være utmerkede mht spesifikasjoner og pris. Og brukerne står ovenfor en vanskelig oppgave når de skal velge. Horace Dediu i Asymco satte meg på sporet i å se hvilken jobb nettbrettene skal gjøre for oss. Jeg har valgt å se markedet som fire mobile plattformer, eller «Eco-systemer», som de også kalles.
More...

InvestorForum by VentureLab in Oslo a success story #startups

Av
Bilde
Photo from Hotel Continental website 200 persons, mostly investors, joined to see what 20 startups could offer in Oslo after the finance crisis . I was astonished to see so many foreign investors, from US and from UK. There was in my opinion a lot of great projects . Since I also presented, I could only follow some: Yes Game : They have ingenuos  reduced the chess board from 8X8 to 5X6 by taking away all second officers. In that way they have create a Chess Attack, which can take you into the final stage of a chess party immediately. They have it for iPhone and very important, also as a physical board. uformia created software very well suited for 3D printing. The CEO Cherie Stamm was an American living in Norway. She softened every Norwegian heart when the said the reason was our beautiful nature. 3D Printing is in my opinion a possibility for the Western society to rebuild the manufacturing industry we lost to China. kikora presented a math editor, which evalua...
More...